I recently reinstalled Win98, because my son installed AOhell. Running an AMD Athlon-850 with 512mb SDRAM, on an 18GB WD drive. It was due for an overhaul anyway - and I had been having the same problems with out of memory errors on Quicken 2001 Deluxe then Quicken 2005 Home and Business Premier. I got to where I would know to exit the program every 10 minutes or so because opening scheduled items lists and account lists would just kill the memory usage. I have about 5 years worth of data - only about a 7MB file.
Since reinstalling Win98se I am STILL fighting out of memory errors. I have the system.ini [vcache] settings locked on 512mb RAM.
I could find nothing on Intuit/Quicken online help dealing with this issue.
In Aug I upgraded from Quicken 2001 to 2005 running on a Dell Dimension 4100 using Windows ME with 256 MB of RAM. Almost immediately began experiencing memory problems so upgraded to 512 MB, but it didn't correct the problem. I'll be working in Quicken for 1/2-1 hr when things start to go south. Sometimes I will get the message "System resources low" or I will try to start another program & get a message that there is not enough memory to start it.
Quicken includes a little routine called Techhelp that allows me to check the amount of free memory. I check memory after starting Quicken but before doing any work, & there are typically more than 230 MB free. I have spoken to 8 Quicken (non)support staff, & they all insist it is a Windows problem. One even had the audacity to say that since it installed, there could be nothing wrong with Quicken! I ran it in Safe mode with no problems, but then not all of the functionality is available. We went so far as to reinstall Windows, & the problem is still there.
I set up a little test to try to narrow this down. I reinstalled Windows ME with the bare number of drivers needed to run the system & no Internet connection. I installed Quicken, reloaded a backup file, & did a full month's work with not one problem. There were 222 MB RAM when Quicken started & 209 when it finished. I then installed Norton Internet Security 2003, deleted the Quicken file, & reloaded the same backup file as before. When I checked, there were 282 MB free. Did the same work I did before & clicked on the "Show Desktop" button on the task bar. There were 263 MB free, but when I clicked on "Close", the Techhelp window stayed up. The only way I could get back into Quicken was to right click on the button on the task bar & <Restore>.
Only bits & pieces of Quicken came back. I could see parts of it & parts of the desktop. Scrolling the mouse acted like a paint brush as more & more of Quicken appeared under it. Clicked on Show Desktop again & got the dreaded "There is not enough free memory to run this program. Quit one or more programs, and then try again." This has been happening with regularity since Aug.
The only other things running were the Windows ME that came with the system & Norton. Neither of them had been updated because there was no Internet connection. Quicken (non)support insists that this is a Windows problem, but Quicken 2001 ran quite nicely with Windows ME & Norton. How can this not be a Quicken bug?!?!
Has anyone out there come across anything similar to this?

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic