Well, we don't know what you bought nor why the plug doesn't fit. So we can't tell where you went wrong.
How about a simple USB hub to connect a few of your current USB devices to? If you want to use it for the disk, better buy a externally powered one.
http://www.newegg.com/Store/SubCategory.aspx?SubCategory=26 shows some.
Kees
I bought a new external hard drive but when I got it home, I realized I didn't have an empty USB port to plug it in. I bought a Hi-Speed USB 2.0 PCI Host controller that said it would give me 5 new ports. I installed it but when I went to plug my hard drive in, the plug doesn't fit. Now I'm not sure what to do. Did I buy the wrong thing? Any way to get this working, or do I need to send it back and order something else?
Thanks.

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic