The D-Link DSL-2740B is some DSL modem/router combo so you are doing what I'd call a hack. Great that it worked but seems to show that a real WAP or a router as a WAP may be the fix.

As to improving your existing router, why not place it halfway between the downstairs and your office. Location is everything with such devices.