WLM for a user only downloads from email accounts that you entered in its setting for that user. So just remove the unwanted email accounts from those settings.

Kees