Like others, I normally advocate switches over hubs; and yes, most routers do come with multi-port (typically 4) switches. HOWEVER, it is important to understand some of the pros & cons before deciding what is best for YOUR network.
To begin with, let's assume we are talking about 'unmanaged' switches and hubs (the kind most often found in very small networks). For our discussion purposes, 'unmanaged' means you can't change how the device operates and you reset it by doing a power cycle.
First, if you have the typical, single, dynamic IP address from your DSL provider, a router with NAT is essential to share your Internet connection among your network devices. Make sure you select a router that handles PPoE connections internally, then tell your DSL modem to act as a bridge, letting your router take care of login chores.
As noted, most routers come with 4-port switches built-in. This may or may not be enough ports for your needs. If not, you will need to use one port on the router's switch to install either another switch or a hub.
Which to choose?
Hubs work by broadcasting network traffic simultaneously to all devices, just like an old-fashioned party-line telephone system. All devices must continually listen for 'their' messages. And if more than one device tries to use the network at the same time, collisions occur and each device must re-send after waiting a random period of time. This can dramatically slow a network. To be honest, on the type of network you propose, collisions shouldn't be an issue. Hubs are also half duplex, meaning they can send or receive, but not both simultaneously.
Switches on the other hand dedicate each port to a single device, store incoming data and forward it to another single port when that port is avaiable. There are no collisions. Further, switches are full duplex and can therefore send and receive simultaneously (provided you use Category 5 or better cables - hubs require Category 3 or better cables - or in some cases, coax). This effectively makes a switched network faster than one using hubs, especially during high traffic periods.
So when is a hub still preferred? - whenever you will be frequently moving devices between Ethernet ports.
Unmanaged switches memorize the devices connected to them at first use of a port. If you change the device connected to that port, the switch doesn't know this. If you frequently move devices between ports, they often will fail to work because the switch thinks they are still connected to a different port. To clear the problem, you have to reset the switch and allow it to re-learn the new device locations.
Whenever you have multiple users, you will eventually inconvenience someone when you kill the network to reset a switch.
The best advice is to use switches in areas where the connections are pretty static, and use hubs in areas where the physical devices are expected to move around. The two devices can readily work together on the same local area network, but of course you will want to make sure that you don't place a hub in between switches or you will create a bottleneck at that point.