I had the same issue, but the wired vs. wireless shouldn't be an issue. I have one machine as my gateway, and the other machines use the static IP of the machine with the modem and the dial-up connection as the "Default Gateway" to access the internet. The only difference is I did not set my router as an access point. I don't know if that is the difference, but I did try it that way and had the same issue where my wireless machines couldn't get to the internet via the gateway. So I changed back the settings on the router so it was not an access point, assigned it a static IP as well, and all started working.
Make sure the Internet Connection Sharing is set up properly on the machine with the modem and land line, and that all remote machines have the IP of the gateway in their IP settings for Default Gateway. Since the PCs can see each other already, it sounds like the network is functioning OK.
Mark
I have 2 desktops and a laptop I would like to network. All are running XP Pro. The two desktops have ethernet cards, plus one has dial-up internet access with a dedicated phone line via an internal modem. (we're lucky we even have dial up in my area). The laptop has a wireless card. I have a Belkin wireless G router that can be used as either a router or an access point. I've played with this a little, hooked the router up, played a little more with ICS, was able to establish a "Residential Gateway" on the client desktop and laptop but cannot for the life of me get internet on any compter other than the host. On the client computers, I've given them static IP's with the host ip used as the gateway. I've been researching on the net for weeks now and always end up with one place saying use automatic assigning only, and the other saying you have to manually set up. I don't have anything plugged into the router except the 2 ethernet cables from the desktops. Should I set my router to be an access point only? Am I going about this all wrong? Any advice is greatly appreciated as I've tried everything I can think of as I am not an IT person. All 3 computers can see each other and share files, printers, even the wireless laptop, I just can't get internet on anything except the host. Any and all help appreciated! (PS I'm using a router because it was given to me for free and it's brand new)

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic