On the server you have gigabit per second access and more to the data and apps.

Over a network you usually get 54 megabit rates and it's shared (WiFi).

So nothing seems wrong that clients are slower than what you can get on a server directly.

I see this question most often from someone that did this their first time.