Rightclick on a shortcut, choose Properties, and click on button called "Other icon" (or something very much like it, I don't have the English version of Windows). Browse to an icon you like, and bingo.
If you prefer a wider choice, have a look at http://www.google.com/search?q=download+icon&meta=
If you prefer to make your own icons have a look at
http://www.google.com/search?q=icon+editor&meta=
Hope this helps.
Kees
Does anybody out there know how to change your Desktop icons cause they ugly. Please help me in the name of looks!!

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic