You would test the modem by connecting it directly to a PC and see if you get a valid IP from your ISP.

The router would use the same strategy through its setup program.