There will be a setting somewhere, either in Tools > Accounts or Tools > Options, to delete the email from the server.
Check that first.
Why does Outlook Express 6 (using WinXP) show 2 emails for every new one I get. Like an echo...I shut it down, load it back up, and they disappear. How can I avoid this nusance problem.