"END OF LIFE" stages. But back to your new router. Since the old routers can't penetrate that floor I doubt much else will.

Let's start with the usuals.

1. Set it up our way (see forum sticky)
2. Consider powerline bridges to put another wifi router or wap on the next floor.