A power supply.
If I review http://www.tomshardware.com/howto/20021021/ I see that with some guesstimation, the 350 Watt power supply might be overtaxed if you factor in that the usual supply overstated its capacity. Try a 400 Watt supply to remove this from the issues list.
As to trying another OS, have you tried a KNOPPIX? I sent a tip to someone about KNOPPIX 3.3 and they published a small article about it. Good to look over if you want to try Linux, but are unsure of having to know Linux.
Great that they went over the data recovery aspect as well.
http://tips.oncomputers.info/archives2004/0401/2004-Jan-11.htm
My specs are:
900 Duron
pcchips motherboard
512 ddr ram
onboard sound, lan.
56k modem.
Hardrives; 1 16gig, 1 160gig.
Operating system windows 98SE/XP Home
Seriously having major problems with my graphics card. It locks up sometimes at startup before windows even gets booted up properly, it locks up when I'm doing run of the mill stuff like opening web pages, it locks up when playing games, and on the subject of games, all the textures and text and the like is all corrupted and weird looking. Tried updating windows drivers, graphics card drivers, tried a different operating system, tried da*n near everything I can think of. I had 98 installed on the machine to start with, and the card worked fine with it. I moved house, and decided it was a good time to upgrade to XP, then all the fun began. I've tried reverting back to 98 with no joy. Someone help me out here or its a case of backing over the comp with my car.
Thanks.

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic