configure the router as a DHCP server (it will hand out the IPs, same job that ICS does). Turn off ICS to eliminate conflicts with the router.

Welcome to the wonderful world of broadband.