That's a mechanical problem. If you're on USB ports because you can't use this one, buy a hub or install a PCI-E USB(-3 if you like) card for more ports.
I don't think the freezing is related. And most often it's impossible to tell the cause, surely from a distance.
So l recently installed a new hard drive in my computer(as the old one had bad sectors) and it solved problems such as bsod and the pc not booting properly
Right now the PC is running well but I've encountered one problem, one of my usb ports doesn't recognise usb's unless I push down on them
another issue is that the computer has frozen a couple of times - one time the mouse keyboard etc stopped working - the cursor did not show up on the screen but both lights in the computer were on and blinking suggesting that the pc hadn't frozen - this happened twice
Another time the pc slowed down and i got a "this program is not responding" error message and then the screen turned orange but i could still see and move my cursor
I ran chkdsk and sfc/scannow and both found no errors
Is this problem serious? And why is it happening?

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic