A standard AV receiver will usually suffice. Typically people with multiple speaker pairs such as yours use ‘zone 2’ (or ‘B’, if an A/B speaker option). A speaker selector connects there, and in your case, to the banana plugs in your wall.

In some cases where you want to maintain relatively high volume levels a secondary small amplifier is utilized via zone 2, between AV receiver and speaker selector.

Look at Russound equipment for this. Crutchfield usually carries some of their gear.

Questions? Feel free to ask.