If memory serves, Charter is a cable Internet company, in which case that will be the problem. Cable Internet is great for downloading, but anything involving uploading (like online games) will not work so well.
Not only is upload bandwidth usually capped at a ridiculously low 128-256K, but Cable is a shared bandwidth system. So some idiot down the street who has a system littered with spyware, and has P2P programs going 24/7, WILL affect YOUR network performance. Anyone who's on the same neighborhood hub as you will have an impact on your performance.
There is no fix for this other than to get a different ISP, or find some way to ensure that you're the only one using a given hub. I'll go out on a limb and say that there's no real legal method of doing the latter that is cost effective compared to getting a new ISP, so that's your only real viable option.
I have my Xbox 360 directly connected into my router but I still get lag making games unplayable. I turned off all my computers so the only thing on my network is my 360. I still got lag. Anyone know or have an idea why this would happen? It's a Netgear cg814gcmr router and modem and my ISP is Charter Communications. Any input will be greatly appreciated.

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic