Your post is void of the wifi details but this issue is usually about settings like a hidden SSID or use of the WEP or lesser security. Changing RF channels can help too.

Then again, unless I take the machine that has lost connection to the room that has the router I can't test if that machine has an issue.

Sorry but this does not sound unique. Just another wifi setup or hardware issue.