First if you have a good connection to the router then we are half way done. The next step is to check your router and see if it has an ip address from you dsl or RR modem.
If you look under status you should see Dns inforation and a ip address for your router. If you dont see this information check with you IP provider to see if you are assigned a static or random address. If you have a random address just set you router up for DHCP. It will pick up the information from your isp. If it is static address you will have to get your ip address, gateway, subnet mask, dns servers and enter the information into your router.
Since you did not include information about your connection to the internet I had to guess. This should point you in the right direction.