I've heard this complaint before and the usual fix is to use some other email application like Thunderbird which offers more control.
Bob