1) Try the Search feature from either machine, first using the computer name then the IP address
2) Check the IP and Subnet addresses, they should be in the same range.
3) Try Netview and Ping from a command prompt.
I recently upgraded one of my two 98se comps in my home to XP. They're connected through a Linksys router, and both can access the internet, do email, and all that stuff. The problem is that they can't see each other for file and print sharing.
I have sharing enabled and stuff shared, they both have the same workgroup name, and I've disabled the XP's firewall.
Any ideas? I'd be extremely grateful.

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic