Version: 2008
  • On mySimon: Pea Coats Are Another Wardrobe Staple
advertisement
How (and why) we've recalibrated
our ratings
John Morris, Editor, Home
Rafe Needleman, Editor, Business Buying Advice

Dear CNET visitor,

Even the finest watch needs to be reset now and then. The same is true for any gauge used for precise measurement, including the tool we at CNET use to determine whether one product is an 8.3 while one of its rivals is only a 5.2.

That's our ratings scale. While we will continue to use the same 1-to-10 scale we have used for years, we're recalibrating the criteria for those numbers. Please see our revised scale at the bottom of this page.

For example, getting a 5 no longer means, as our old criteria stated, that a product is "mediocre." Instead, a 5 means "average," what you'd expect for something that sits at the midpoint of a 1-to-10 scale.

This single change makes way for others. To receive a 9, a product can't be just "excellent," as in our old criteria; it has to be "spectacular." At 8, it's no longer "very good"; it's "excellent." A 7 is no longer just "good"; it's "very good."

This revised scale gives us more room, so to speak, or the opportunity to emphasize the differences between one product and another. And this, we hope, will make it that much faster and easier for you to browse, filter, and choose the products worth your time and money.

We'll begin using our revised scale on April 15 for all new product reviews. Over the following two weeks, we'll also rerate our top products in every category. All changes will be complete by April 29.

You may note some disparity between products rated according to the former scale and those rated according to the new one. That's why we've decided to give you a heads-up by putting an editors' note on any review where the product has been rerated, at least until enough products are in the new scale to ensure normalization.

One last thing: Even though we may change the rating on some products, we're not changing our opinion of them. In other words, if you bought an 8, our good opinion of the product hasn't changed now that it's a 7. It will be easier, however, to tell the difference between that product and one that receives an 8 in the new scale.

The good, bad, and the bottom line won't change, nor will our Editors' Choices, nor our dedication to providing you the best possible advice for choosing and using tech that improves and enriches the way you work, play, and travel.

Sincerely,

John Morris, Editor, Home
Rafe Needleman, Editor, Business Buying Advice



What the numbers mean

10.0 (Perfect): This exceedingly rare score is reserved for a product that is as perfect as it could be.

9.0 to 9.9 (Spectacular): A product that receives a rating in this range scores high on all of its rating criteria. It succeeds at meeting all of its intended users' needs and has no meaningful drawbacks.

8.0 to 8.9 (Excellent): A product that receives a rating in this range is superior in so many ways that its relatively few drawbacks are not very important.

7.0 to 7.9 (Very good): While the strengths of a product scoring in this range certainly outweigh its weaknesses, it has some minor faults that certain users should be aware of.

6.0 to 6.9 (Good): This range represents a product that is above average. Its strengths slightly outweigh its weaknesses, making it good for most uses but not a standout.

5.0 to 5.9 (Average): A product that scores in this range is functional but unremarkable.

4.0 to 4.9 (Mediocre): Products in this range are below average. They fall the middle of the pack for most features, but suffer from a few additional major flaws.

3.0 to 3.9 (Poor): You probably should not consider a product in this range or lower. There may be one or two specialized circumstances, however, that could justify the purchase of this product for a very low price for a specific demand.

2.0 to 2.9 (Terrible): A product that receives a rating in this range scores low on all of its rating criteria. It does not satisfy any of its intended users' needs and has no meaningful strengths.

1.0 to 1.9 (Abysmal): A product in this range should never have been produced. This product has no redeeming qualities and worse, may actually harm you or your productivity.