In Internet Explorer:

Tools > Options...
Click "General" tab
Click "Clear History" button