It is relatively easy to replace the ethernet card, but since it's happening to both computers I'd try taking the router out of the loop and connecting the modem directly to the desktop for a while and see how it works out. Then swap the modem over to the laptop only and see if the problem continues.
* If both fail to connect it's likely the modem.
* If neither fail to connect it's like the router.
* If only the desktop fails to connect it's likely the ethernet card.
The problem may be as simple as needing new drivers for the ethernet card or firmware for the modem or router, so check with the manufacturers to see what updates are available.
John
Hi, I hope someone can help me...we have 2 computers, desktop and laptop and upon starting up the computer every day we are unable to access the internet (on the desktop) and we have to unplug the modem and then the router and then wait a bit and then reconnect. We thought we may have had a virus or some kind of messed up settings, so we reformatted the computer and are still having this problem...someone I work with suggested that we may need a new ethernet card for the desktop (the problem seems more prevelant on the desktop). Also sometimes, the internet will just cut out at times for no apparent reason and then we have to disconnect/reconnect again. We have Windows XP professional software. If we do need a new card, is it something that can be easily installed at home? Thanks so much for any help!!

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic