I have a 5.1 AV receiver for HT and a separate stereo amp and 5 CD changer for for the remote speakers.
You do have keep in mind the 4 Ohms is the lowest load the amp will drive. I don't know if you could drive ALL of the speakers at the same time. If not then you will need the switch box. John