But I think this is one of those questions that has been discussed a lot. So before we start a new discussion check prior answers with a search like this.
http://duckduckgo.com/?q=can%27t+delete+email+in+windows+live+mail
Hope this helps,
Bob
PS. Not a Live fan (Happy Halloween!)
I received a message today in my junk mail box and I am unable to delete it.
Whenever I press delete, a window appears with the following message: An unknown error has occurred.
Then a Windows Live Mail window showed up with the message that it 'had to shut down'.
After several attempts, another window appeared: Deleting messages, but it just ran and ran without anything happening.
I have re-started my pc, but the message is still there.

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic