You can do some testing with YSLOW to see where your site is slow. (see google to find that tool)

With the removal of Net Neutrality, all bets are off if your ISP is degrading sites.
Bob