Could be a setting in Outlook (though the default setting would not account for this, it may have been changed). bear with me 'cos I'm using an older version of Outlook. Go into your mail account properties (Tools - Accounts - Properties).
Click the 'Advanced' tab. Here you should see an option saying "Leave a copy of messages on server". It should NOT be ticked. Untick if necessary.