And unless you have rather high end broadband, you won't likely be happy with the performance. Not to mention your office IT people, if they're earning their paychecks, will have the company firewall set up to disallow such things without jumping through many hoops, which will take a toll on already poor performance.

I tried this once on a private LAN, using a 100Mbps connection, and even then I found it obnoxious to use. The amount of bandwidth needed tends to mandate a gigabit connection with virtually no latency, if not more, for anything close to resembling the performance you'd get if you were sitting right at the system.