Moving to Office 2008 will probably fix the problem.
2004 had no idea what a 2 core processor was, let alone an 8 core.

Alternatively, move to Open Office or iWorks.

Oh yes, I would also suggest that you do not leave 2004 running when it is not needed.