• On TV.com: BATTLESTAR Galactica Maxim Photoshoot
September 9, 2008 3:48 PM PDT

On call: Why we haven't lowered the iPhone 3G's rating

by Kent German

The iPhone 3G still warrants an excellent rating.

(Credit: Corinne Schulze/CNET Networks)

When you review an Apple product, you can be sure that readers will say one of two things: either you didn't rate it high enough or you rated it way too high. Rarely, if ever, is there any middle ground.

Just take the review of the original iPhone, for example. Soon after we posted it last June, letters from CNET readers started pouring in. As veteran Apple reviewer Donald Bell had predicted, the letters fell into the aforementioned camps. However, after some time, I noticed that most readers felt we were too hard on the iPhone, which received an "excellent" rating of 8.0 (or four stars out of five). From our perspective, the rating was justified: although the iPhone was a gorgeous device with a fantastic display, a great user-friendly interface, a top-notch media player, and a breakthrough Web browser, it suffered from variable call quality and a lack of basic cell phone features. That's why Donald and I withheld the CNET Editors' Choice award.

Now fast-forward a year to our review of the iPhone 3G. Since the second-generation iPhone brought a host of added features and better call quality, we assigned a higher rating--an "excellent" rating of 8.3, which also equals four stars under CNET's new rating system. This time, however, we left the possibility of an Editors' Choice award on the table and decided to wait for full battery testing results to make that decision--on the first day of use, I had noticed the battery depleting too quickly while using the 3G network. So we posted our review and waited.

While we waited, I got a different set of letters. As concerns about the iPhone's dropped calls, battery life, and shaky 3G connections grew louder, I received many letters complaining that we had been too easy on the iPhone 3G. Readers asked me to reconsider the rating because of the problems that were affecting so many iPhone customers. Of course, the problems concerned me, but I wanted to see them for myself before I took action. (It would be irresponsible and a disservice to CNET readers if I adjusted the rating based solely on reports I had heard from other people.)

It took a while to put our review iPhone 3G though the battery drain paces and get it back from CNET Labs, but once I did, we performed more usability testing. And gradually, we did notice a few problems. Dropped calls on our phone remained rare, but the 3G connection issues were apparent. Specifically, I noticed the weak connection and the sloppy hand off between the 3G and EDGE networks. Also, while the official CNET Labs battery testing results fell within the promised times, our iPhone's battery came close to running out after a long day of heavy multitasking. I added the new observations to the iPhone 3G review and spent time questioning whether they warranted a rating change.

Ultimately, we felt the issues that we experienced on our review device weren't reason enough to reduce the iPhone's 3G's rating. We are, however, withholding the Editors' Choice award once again. We agree that these problems are significant, but the iPhone 3G remains a landmark product in many ways. It still offers a great design, the interface and display are no less lovely, the music player and Web browser remain top-notch, and we admire the App Store. Even the sometimes-frustrating Microsoft Exchange e-mail support merits a few points. But more importantly, we want to see whether Apple successfully fixes the problems, as the company said it is planning to do on Friday, September 12 with the 2.1 software update. If the problems continue to persist over the next few months, we'll revisit the issue.

Kent German, CNET's cell phones guru, answers your questions about cell phones, services, and accessories and reports on the state of the industry. Send him a question.

Kent German is a senior editor for cell phone reviews at CNET. When he's not testing the newest handsets on the market, he's blogging about cell phone news for Crave. In his On Call column, he answers reader questions and gives his take on the rapidly changing mobile industry. E-mail Kent.
Recent posts from Dialed In Podcast
The 411: Storage limits and more on data plans
Verizon's LG Chocolate Touch is nice but nothing new
Droid does multitouch, Milestone does it better
Sprint to also offer RIM BlackBerry Curve 8530
Verizon reveals the Casio G'zOne Brigade
Samsung Mythic and Flight on sale November 8
Verizon's November feast
Samsung's Convoy goes rugged
Add a Comment (Log in or register) Showing 1 of 2 pages (38 Comments)
by cardfan1212 September 10, 2008 4:16 AM PDT
Have you admired the many palm and wm app stores over the years? You do know all you have to do is go to any of the several sites that sell wm or palm apps and boom, you're downloading trial apps (what a concept) to try out for free. Unlike apples buy it and be stuck with it system.

Have you admired the lag of the iphone 3g or the constant browser crashing or apps crashing? It happens much more on this phone than it ever did on my palm treo. Not to mention the dropped calls.

You admire the great design? It's plastic thin design just begs to be dropped. This isn't a great design.

Do you admire the multihour sync sessions?
Reply to this comment
by big.mouth September 10, 2008 8:35 AM PDT
Please. My Palm and Windows Mobile phones are pieces of s**t compared to my iPhone 3G.

And your Treo rarely crashed? Baloney. I've owned several and they had to be reset weekly.
by bubblebathgirl September 10, 2008 9:36 AM PDT
Don't be angry, it's really not very attractive.
by Dr__Nick September 10, 2008 4:46 AM PDT
Would you cut Nokia or Motorola this much slack? The phone has serious issues that other phones on the same network don't have- your ratings are way high.
Reply to this comment
by strongpimphand September 10, 2008 5:50 AM PDT
I don't understsand.....

The phone is called "iPhone 3G"

You've admitted that you're having problems (like many other consumers) with the 3G part.

How much more cut and paste does it get????? If the upgraded feature is lack-luster, then it shouldn't be rated any higher than the original feature!

In fact, here's a simpler example: I create a new brand of juice. You decide it's excellent and give me a high rating. I create an updated version of it with a promise of it being sugar free. I call it "juice free". Yes, the juice is free of sugar.....but it has a horrible after taste. Are you going to give me a higher rating because I still kept my promise???

Are you going to wait until I correct the problem before lowering my rating??? Lord knows there are consumers who live by ratings. They see that you gave my updated juice an 8.3 and they might feel confident to try it...
Reply to this comment
by big.mouth September 10, 2008 8:32 AM PDT
Do you even own an iPhone 3G? Heck, do you even own a 3G phone?
by kennethkearns September 10, 2008 6:58 AM PDT
Why all the Hate?

Look I worked a few years with a company that made Windows Mobile phones. Admittedly this OS has the ability to be more functionaly than the Iphone OS. However, when I handed it to my wife and asked her to (1) play me a video (2) play me a song (3) send me a text msg (4) send me an email (5) call me.

How many could she do? Only two. Now On the iphone she can do all of them.

Is the phone perfect, absolutely not. Does it enable the vast majority of the technoidiocracy to do much more with there phone then previously, absolutely.

This has to be worth something. Especially when these issues are not over 100% of the devices.
I wonder if Mister German scored all Windows Mobile phones lower then iphone because
Reply to this comment
by big.mouth September 10, 2008 8:31 AM PDT
You are WAY overthinking this. It's a an excellent phone and merits and Editor's Choice.
Reply to this comment
by mbenedict September 10, 2008 9:15 AM PDT
We all know CNET is heavily biased when it comes to Apple, one of CNET's major advertisers.

Please don't patronize us by trying to "rationalize" this bias somehow.

Not docking points for the iPhone 3G which has serious 3G issues is just silly.
Reply to this comment
by PDubs September 10, 2008 9:31 AM PDT
I'm in the same boat as kenneth.

I came from the WinMo 6.0 world and while that O/S was great and the free apps were endless, the UI started to really grate my nerves. I moved to the iPhone 3G a month after it came out, even through all the reports of dropped calls, bad connectivity, etc. My girlfriend ran into the same problem where it was pop out the stylus, try to find the app required, etc. With the GUI of the iPhone, that confusion has now been expunged and I haven't even really run into the issues most have complained about. But, I haven't upgraded the firmware since my original purchase either.

You have to realize, this one truly is more than just a phone. The main example I can give is from personal experience. I got really tired of bringing in my laptop, personal cell, work cell, badge, and MP3 player (I'm withholding the name in the interest of staying on topic; not an iPod). Just the sheer combination of 16G of space + MP3 + Phone ability eliminated the need of bringing in my MP3 player. Now I have music whenever and wherever I want it at my noisy office. WinMo phones didn't have nearly the elegant interface to play music, nor the storage capacity short of purchasing an additional card and even then, it was a toss-up as to how much external storage space each phone could read.

It's by no means the perfect device, plenty of flaws remain, but for the price point and features, you really can't go wrong. And just one more note, this is my first apple product purchase so no need to start throwing the Apple Fanboy daggers.
Reply to this comment
by bubblebathgirl September 10, 2008 9:40 AM PDT
The iPhone 3G works better then any smart phone out there, even with whatever issues may exist. As these issues get resolved, it just furthers the iPhone 3G's advantage over the market.

The complainers posting here most likely don't actually own one, and unfortunately, purchased a more inferior product by a wanna be smart phone company. They're all playing catchup to Apple, and ironically, just making the iPhone 3G look better in the process.
Reply to this comment
by IowaNinersFan September 10, 2008 8:11 PM PDT
People that bought smartphones NOT made by Apple paid less and got phones that actually WORK on the 3G network and DO NOT require software upgrade that half arse work and in fact, made the problem even worse than before.

If I pay $300 for a product, I do expect it to work out of the box and not require it to be reset, turned off and on, reset again and then upgrading the software.

So has the 3G issue been resolved? Inquiry wants to know.
by bubblebathgirl September 10, 2008 9:46 AM PDT
The iPhone 3G works better then any smart phone out there, even with whatever issues may exist. As these issues get resolved, it just furthers the iPhone 3G's advantage over the market.

The complainers posting here most likely don't actually own one, and unfortunately, purchased a more inferior product by a wanna be smart phone company. They're all playing catchup to Apple, and ironically, just making the iPhone 3G look better in the process.
Reply to this comment
by twerner81 September 10, 2008 9:53 AM PDT
Buy an ipod touch so you don't have the hassle of the iphone.
Reply to this comment
by soulweaponry September 10, 2008 11:04 AM PDT
best advice i've heard all day. All the special iphone features people are looking for are inside the ipod touch. Why not get one? The hype
by ickray September 10, 2008 10:55 AM PDT
I just don't think a cellphone that has issues maintaining a voice connection deserves a rating of 8.3/10. I don't think a smartphone whose apps continually crash deserves an 8.3. I don't think any portable device w/ crummy battery life deserves an 8.3.

These very important criteria must not have been considered when assigning the rating. Otherwise, the rating would have been lower.

Apple is cut much too much slack.
Reply to this comment
by shootdraxxus September 10, 2008 11:07 AM PDT
I am not surprised that at the end of a day my iphone 3G has a near drained battery. I play music at least 8 hours a day from it at work. I text often enough, and use the internet on the phone to get around the blocked websites (my company blocks everything useful, including yahoo images). On top of that I make some calls. Then when I get home, I make calls and use the Wi-Fi. I am astonished to see my phone still having 20% battery life. Am I just missing something? Because I keep hearing that the battery of the iphone 3G doesn?t last long and for all that is done on this little machine I would figure you could cut it some slack. I mean, it slips right into your pocket. It?s a good thing apple is working on the new nuclear powered iphone?s ;)
Reply to this comment
by isykal September 10, 2008 11:09 AM PDT
For those who think it's okay for Apple to get away with this, you guys must either be Fanboys or are really rich. I didn't pay $300 for the device and $100+ monthly (contract: 2 years) to go through all these headaches over a phone that didn't live up to its promises. That's NOT OKAY!

Apple deserves all this hate. I will never buy an Apple product ever again!
Reply to this comment
by myles taylor September 10, 2008 11:11 AM PDT
I think it's funny how people think Apple is cut too much slack. I think they are cut the least amount of slack! It's their fault and they are a victim of their own success. Being a seen as the leader in innovation and such, they are held to a higher standard than other companies. Most of the problems people have with Apple devices are petty and miniscule. No one can get everything right. People expect perfection from Apple and they don't from other companies. That means that when Apple gets something small wrong, people want to see it nailed.
Reply to this comment
by Motyoj September 10, 2008 11:32 AM PDT
I have no problems with my iPhone 3G except a gripe about battery life, which is supposed to be improved in the next update on Friday. It syncs in less than a minute and I have had no dropped calls. The features are nice but could use some improvement. It's the coolest phone I have ever seen or used. If I didn't use a Mac, I wouldn't think the thing would be all that great, considering it doesn't sync nearly as well with non-Apple boxes. But whaddya expect? So much software is crappy because of laws, money, and people wanting to do bad things with it. Not a perfect world for sure.
Reply to this comment
by big.mouth September 10, 2008 12:08 PM PDT
The proof of the pudding is in the eating. I held onto my ATT Tilt with Windows Mobile and 3G in case I had problems with the iPhone. I haven't had to use the Tilt for anything except streaming the occasional Windows Media feed. Performance, call quality, battery life, etc. are ALL superior on the iPhone 3G.
Reply to this comment
by Two More September 10, 2008 1:03 PM PDT
I disagree. I purchased a 3G and decided to return it after two weeks. Call quality and reception were nowhere near that of my AT&T Tilt . The 3G is an outstanding iPod, but a very average phone at best. As a 20+ year Apple user, I'm very disappointed.

Yes, times they are a changin'.
by xanpyzz September 10, 2008 12:13 PM PDT
I own 2 3g's, Love the product but every update and now Itunes 8 causes a BSOD on Vista - what is going on at Apple. Is something broken. The first firmware 2.0.1 caused a total crash of the first phone and 6 hours of work. 2.0.2 went on the first phone ok and destroyed the second phone. This took another 3 hours to fix. Look on the Itunes 8 windows and you will see a big problem with Vista HUGE!!!!

This appears to be a problem product and we had to turn off the 3g due to constant dropped calls.
Reply to this comment
by xanpyzz September 10, 2008 12:22 PM PDT
I own 2 3g's, Love the product but every update and now Itunes 8 causes a BSOD on Vista - what is going on at Apple. Is something broken. The first firmware 2.0.1 caused a total crash of the first phone and 6 hours of work. 2.0.2 went on the first phone ok and destroyed the second phone. This took another 3 hours to fix. Look on the Itunes 8 windows and you will see a big problem with Vista HUGE!!!!

This appears to be a problem product and we had to turn off the 3g due to constant dropped calls.


Yes the product with all its faults is way way way superior to my Blackberry 8800. and that is way I love the phone! The glitches are a little disappointing.
Reply to this comment
by Professah September 10, 2008 1:07 PM PDT
I find it really funny that a rating for a phone, that like others have said, "most of the complainers DO NOT own", is such a big deal. I mean, those of you who own phones besides the iPhone and even those who do not like it and have gotten rid of it, that's GREAT!! But what is it to YOU that it is rated what it is rated. Do you think other people/devices are being cheated because this? I cannot understand this. Is it really affecting you that bad that you want to see the score changed? Or is it that you are just as bad as Apple fanboys (but vice versa) and dislike this phone so much that you want to see it lowered for you to feel better inside and reassure your choice to not own this product?
Reply to this comment
by billeeyum September 10, 2008 10:46 PM PDT
The reason the score should be lowered if this is not fixed is because many, many people use this as a resource for choosing a phone. They may think differently of purchasing one if they see that the score was lowered due to these issues, or at least be forewarned. I know many people who do not follow tech news at all, don't know that the iphone 3g has all these issues, but still look at these reviews when looking to buy a product. Plus if there was a super anticipated device from any other company that initially was rated this high then had this many issues, I think it would be changed, at least I hope it would. I don't care if it runs windows mobile, android, symbian, or whatever else.
by Dalmatian28 September 10, 2008 2:00 PM PDT
CNet bias???...sad but true!!!!!
The "unwritten rule"....when it comes to Apple and Google products, you just can NOT trust CNet!!! I have to give CNet credit that they do pretty good job with products that comes from other companies. Usually that make up around 95 % of the cases! The moment you start talking about Apple/Google Products ...it feels like they loose their minds. Suddenly you get the feeling that they stop being CNet employees and turn into Apple and Google advertisers. Why is this happening???? What happen to professionalism??? High standards??? If the product from Apple/ Google has issues or it is falsely advertise (like iPhone)...don't be afraid to say so! Based on the review from this site and the fact that I was IDIOT to believe you...I bought the stupid iPhone only to go back to my Black Barry couple days later. Now I am stuck with iPhone contract that I don't use!!!
Why was so hard to write that iPhone price is not final price that the people will pay for it. They will have to pay for the warranty that you must buy even if you don't want it because you have to replace battery stupid battery that can't last 4 hrs even when it is new. Another thing is what about the typing. The keyboard is a pure junk. Try typing something on it. The 3 G...that is the best joke of 2008. GPS...haha Buuuu. This product (iPhone) is NOT entirely bad and it has so many great things in it ....but your job was to show us the bad side so we can decide. You fail and you did it miserably!!!! Please STOP being advertisers and do your job on fer and honest way so your readers don't get screwed by trusting your reviews! NO APPLE'S AND GOOGLE'S ADVERTISING PLEASE!
Reply to this comment
Showing 1 of 2 pages (38 Comments)
Subscribe to the Dialed In podcast

Subscribe to the audio podcast via RSS
Subscribe to the video podcast via RSS

Subscribe to the audio podcast via iTunes
Subscribe to the video podcast via iTunes

advertisement

About Dialed In Podcast

Whether it's for just making calls or for cramming your entire life into one device, the ubiquitous cell phone continues to evolve. Each Wednesday cell phone editors Kent German, Bonnie Cha and Nicole Lee meet to discuss the latest cell phone news and answer your questions. Join us to find out what's in, what's out and what's coming next.

Send us e-mail at dialedin@cnet.com or call us at 1-866-402-2638 (CNET) and be a part of the show.


Add this feed to your online news reader

Dialed In Podcast topics

More on Dialed In
Dialed In on CNET Live
Dialed In Facebook group
CNET Reviews: Cell phones
Cell phone ringtones and accessories
Cell phone user forums
Discuss cell phone: Make the call
On Call columns
Cell phone blogs
Cell phone features
Meet The Dialed In hosts
Bonnie Cha Bonnie Cha reviews the latest smart phones, PDAs, and GPS devices, helping CNET readers get their hands on the latest mobile electronics. See profile
Kent German Kent German is CNET's cell phone editor and has been following the wireless industry for seven years. He's embarrassed to admit he can name almost any cell phone he sees on the street. See profile
Nicole Lee Nicole Lee reviews cell phones and their accessories for CNET, thus satisfying her love for all things small, shiny, and digital.See profile
Podroll
When you're not listening to Dialed In, here's some other great podcasts to try.
The Cell Phone Junkie
The Apple Phone Show
60-Second Science
East Meets West
Other CNET podcasts