Yep, sounds like one or more of the updates is/are corrupt or conflicting with the system or it's settings. I would, as you have done, delete those particular updates. Then download/install them one-by-one until the culprit is revealed, then leave the culprits off the system. And meanwhile contact MS regarding the update problem you are experiencing. At their update page, they have a link leading to a Help menu. Emailing them regarding update matters is free these days.
Also, it's not uncommon for an update here or there to cause problems. Sometimes even a security update is simply more trouble than it's worth.
Charlie
When I try to open IE the window opens, connects and then closes again. When I try to open the "Help and Support" or ?system restore? absolutely nothing happens. I have run a virus check with AVG and it shows nothing. I have booted in safe mode but still have the same symptoms. I am running Windows XP Home Edition with Service Pack 2 and automatic updates. I have run sfc /scannow, once this is completed, everything works fine. However, when I reboot, the problems return. All is OK until I install the latest Windows updates. I currently have 5 to install:
Cumulative Security Update for Internet Explorer 6 for Windows XP (KB933566)
Cumulative Security Update for Outlook Express for Windows XP (KB929123)
Microsoft GDI+ Detection Tool (KB873374)
Security Update for Windows XP (KB935839)
Security Update for Windows XP (KB935840)
If I restart the computer or shut it down without installing the updates, it reboots OK and everything works OK, so it would seem that one or more of the updates is causing the problem.
Any thoughts?

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic