whose sole aim appears to be to achieve the leanest, fastest and most indestructible computer on the planet. They spend almost all of their time tweaking and testing and very little...if any...having it do useful tasks.
Since I have and do use multiple systems on my boxes, I am very aware of system performance across the board; however, this is not true for most computer hardware related sites. What reasons are there for not using at least three unrelated operating systems to test performance?
I can only think of: apathy, sloth, and wanton ignorance.
Not even this site will test to such an extent.
Of the tests: Stress the box! Playing a game requires less of the cpu and memory than making one does. There is the test, in the creation not the execution of an application. Using systems that require little memory- such as minix- to those that are demanding- such as windows- on the same box would give a fair and unbiased review of the product. Add limiting memory to that and you have a great way of testing.