Java updates should be deletable, but updates to Windows Media Player (and other Microsoft programs) should be kept. Besides, with virtually all updates to Microsoft programs, they merely replace the "broken" file with a "fixed" one, so the net change is usually very small.
Do I need to keep previous updates of Java or previous security updates for Windows Media Player? I have an extremely small HDD (25GB) and I need the space.

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic