Inside CNET Labs Podcast

Read all 'Benchmarking' posts in Inside CNET Labs Podcast
October 16, 2009 4:00 AM PDT

Performance showdown: Windows 7 vs. Snow Leopard

by Dong Ngo
  • 422 comments

Snow Leopard consistently beats Windows 7 in many general performance areas.

(Credit: Dong Ngo/CNET)

As someone who uses both platforms for work and personal entertainment, I've been wanting to do a performance comparison between Windows 7 and Mac OS X since I first got my hands on the Windows 7 RTM (the final build of the OS) more than two months ago, but decided to wait until I could compare the two apples to apples. (No pun intended.)

The right time seems to be now, as Snow Leopard has been out for a while and has even been updated to 10.6.1, and Windows 7 has been at the OEM (original equipment manufacturer) vendors for almost three months and has also had a few updates. Furthermore, Boot Camp 3.0 seemed to make Windows run better than ever on a Mac.

... Read more
Originally posted at Windows 7 Insider

July 31, 2009 4:37 PM PDT

Windows 7 on MacBook Pro: Nice, but still has poor battery life

by Dong Ngo
  • 97 comments

Windows 7 rates my unibody 15-inch MacBook Pro at 5.3, which is very high for a laptop.

(Credit: Dong Ngo/CNET)

I have had Windows 7 Ultimate RTM (release to manufacturer) for a few days. This is, of course, a legitimate copy, not the leaked copy that you can download from the Internet. That's the good news.

The bad news is I have had to test it, which has been lot of work. We tested the new operating system against Windows Vista SP2 and Windows XP SP3. Overall, Windows 7 offers a much more pleasant experience than Windows Vista. Everything works more smoothly. The new OS takes less time to launch applications, and it's nice just to browse around its functions and features. It's also very pretty. However, it is slower than Windows XP, except for the boot and shutdown times, where XP has always been a drag.

... Read more
Originally posted at Crave
November 4, 2008 4:00 AM PST

Universes! Get your DIY universes here!

by Eric Franklin
  • 3 comments

I've always been fascinated by the concept of alternate universes. I imagine various universes in which an Eric Franklin does not work for CNET in San Francisco, but instead still lives in his hometown of Chicago and owns an import video game/comic book/action figure shop.

Or maybe, instead of refusing to join his high school football team at 16 as I did, Eric Franklin No. 3213 not only joined the team, but became an NFL superstar. Hey, athleticism runs in my family so that last fantasy ain't so far-fetched.

I'm honestly not sure what I'm looking at here, but that doesn't mean I don't want one.

(Credit: New Scientist)

Although my chances of becoming a god by absorbing the life forces of countless versions of myself across multiple universes are slim at this point, I still enjoy the possibility. Now, for just $20 I can increase the amount of different me's out there just in case I one day stumble upon a universal rift, thereby creating my ultimate path to divinity.

New Scientist is reporting that conceptual artist Jonathon Keats has created a make-your-own-universe kit, based on the multiuniverse theory that arises from quantum mechanics.

This theory basically assumes that if two events are possible, then both events occur simultaneously until an observer determines the outcome.

The most famous of these experiments, known as thought experiments, is Schrodinger's cat. As New Scientist points out, Schrodinger's cat is an experiment "in which his cat may have been killed with a 50 percent probability; the cat is both alive and dead until someone checks. When the observation is made, the universe splits into two, one for each possible outcome. For example, Schrodinger's cat would be alive in one universe and dead in the other universe."

The site goes on to say that the kit "uses a piece of uranium-doped glass to create a steam of alpha particles, which are then detected using a thin sliver of scintillating crystal. Each detection causes the creation of a new universe."

The device will go on sale at the Modernism Gallery in San Francisco on November 20. I estimate my dimensional rift will be appearing soon after that. I'll keep you posted.

Originally posted at Crave
September 17, 2008 5:15 PM PDT

Monitors, displays, and nearly everything in between on ATE Live

by Eric Franklin
  • 1 comment

Luckily for me, there isn't much in between monitors and displays. Luckily for you (I hope), I'll be answering any and all questions pertaining to computer monitors on Thursday, September 17, from 11 a.m. to noon PDT (2 p.m. to 4 p.m. Eastern). Here is the link in advance.

Show up early or late, whichever floats your boat, and I'll see ya there.

Originally posted at Crave
August 6, 2008 11:25 AM PDT

Just what's so 'dynamic' about contrast ratio anyway?

by Eric Franklin
  • 2 comments

We test monitor contrast ratio in a secret, undisclosed location.

(Credit: Eric Franklin/CNET Networks)

Vendors want to sell you stuff! There, it's finally been said. Don't believe me? Well, you wouldn't be the first, but thankfully, I have evidence.

Within the last year I've seen a new spec, called dynamic contrast ratio (DCR), tossed around for computer displays. If you didn't know before, contrast ratio is simply the difference between the darkest blacks and the brightest whites a given display can produce.

Typically, computer displays have a contrast ratio of about 1000:1. However with DCR, you'll see numbers like 4000:1, 10,000:1, and higher. Basically, it's just a way for Company A to proclaim, "Don't buy Company B's monitor because it has a much lower DCR than our monitor." Since more and more vendors have been pushing this, I want to delve further into how they're getting these numbers. I also covered this topic in less detail (but with a sexy voice thrown in) in episode 2 of the Inside CNET Labs podcast.

Before a monitor is released to the public it goes through a bunch of testing in the vendor's own lab. These tests produce the specs that the vendor will then publish with the release. Specs like maximum brightness, pixel pitch, pixel response time, contrast ratio, and dynamic contrast ratio are all determined in the vendor's own lab.

When testing normal contrast ratio, vendors use a device that measures light to determine how much light is emanating from a display while it's showing both a completely black and a completely white screen. They then take each number, do a bit of math, and come up with the contrast ratio.

... Read more
July 16, 2008 10:57 AM PDT

My breakfast, lunch and dinner (times two) with the iPhone 3G

by Eric Franklin
  • 4 comments

Our MP3 player testing tool in action

(Credit: Eric Franklin)

So last Friday (7/11, "iPhone day") I'm getting ready to do some performance testing on the iPhone 3G. Well, if by "getting ready" I mean stealing pizza and pop (hey, I'm from Chicago) from the poor saps--I mean fellow CNETers that were in the office since 4 a.m. that day to cover the second coming of the Second Coming. Don't hate. This is how I roll at CNET, and my colleagues respect me for it. I mean, why else would they suggest I do First Look videos like this?

Anyway, my plan was to use the testing tool you see pictured here to test the battery life of the phone while it's first playing audio and then while playing video. This is an in-house developed testing tool that allows for the unattended drain and subsequent recharge of an MP3 player's battery. I need only be present to start the test initially and then again after the recharge (more on this tool in a future post). I figure with the 3G I can get at least one run of each the audio and video drains in over the weekend and since the first-gen iPhone lasted over 25 hours last year with the audio battery drain, I'm thinking I can get the 3G tested within one, maybe two trips to CNET the whole weekend.

Mr. Kent German, however, would see things differently. Kent usually does the talk time tests himself, and at about 3 p.m. that day he says that this test is the highest priority and that it should be done ASAP. Well, my first thought was, "I guess you need to get on that then, huh, Kent?" Alas, after a few seconds of my brain catching up--fueled by Kent's blank stare--I realized he was referring to me. So, there go my plans for a very productive weekend of WoW.

The testing tool I mentioned before is not compatible with our cell phone talk time test, so I'd have to do it manually. This entails taking an MP3 player and connecting it to a laptop or desktop via USB (to keep it powered). I then tape one earbud to the mic on a landline phone and the other earbud to the mic of the iPhone 3G. I call the landline from the iPhone 3G, pick up the receiver on the landline, and the test begins. Thanks to the call duration feature that every cell phone I've ever owned in the past has, it'll be extremely easy to determine the talk time. So I charge the phone, start the test, and head home to sleep off some pizza.

What I didn't realize until Saturday morning (other than the fact that unrefrigerated, leftover pizza keeps horribly) when I came in to recharge the phone after a night of draining the battery, was that the iPhone does not have a call duration feature. Nope, it does not natively record how long individual calls last.

At this point I'm desperately trying to figure out how I can access the duration of the last call, cause I mean, come on, there has to be a way, right? Also, it would suck if the last 12 hours had been a complete waste. Now, I could access the account for the phone at AT&T's Web site, but this phone was activated by Apple, and who knows if they have the login info for the phone. Also, it's Saturday and I'm sure our Apple contact has something better to do than to be checking her e-mail at 7 on a Saturday morning. So I call my girlfirend, who has an iPhone to ask her if I've missed anything. After a few minutes, she figures out that although there is no call duration feature, there is a Usage feature.

In General Settings/Usage you can see how long the phone was in use since its last full charge. Luckily I'd charged it to full the night before, so the usage duration is accurate. So, all I have to do is start charging the battery again, drive home, come back in 3 hours (about how long it takes to charge when plugged into the wall) start the talk time test, come back 5 or 10 hours later (depending on if I was testing with 3G on or off), check the usage duration, start charging the phone again. Wash, rinse, repeat...repeat...repeat. Yeah, this was pretty much my weekend. I ended up visiting CNET a total of six times over Saturday and Sunday. Once each day in the early morning, the afternoon and at night. Yeah, I pretty much became a creepy stalker for this particular iPhone 3G over the weekend.

The Usage feature saved me from at least one wasted night, but I'm still perplexed as to why there is no call duration feature. I'm hoping Apple will implement this soon, as I plan to eventually get an iPhone and I like to know how long my conversations last sometimes.

So, what did I learn during this ordeal?

1. Kent German is cold-blooded.

2. Apple needs to add a call duration feature into the phone if for no other reason than to make the lives of the people that have to test this thing a lot easier.

3. CNET owes me gas money.

4. It would be helpful to plan better for future testing of high-profile products.

5. Free parking in the CNET parking garage on the weekend is win.

Originally posted at Crave
June 30, 2008 5:12 PM PDT

Viewsonic offers affordable 26-inch display

by Eric Franklin
  • 7 comments

Birds, flowers, and geometric shapes. Oh, my!

(Credit: Viewsonic)

Twnety-six-inch displays are not the most common size of monitor out there, but Viewsonic is doing their part in changing that. Today they announced the Viewsonic VA2626mw for a price of $530. This price makes it cheaper than Dell's 24-inch model, but still more expensive than some of the others we've reviewed. I mean you are getting two extra inches here, though...

You're also getting a DVI, VGA, and HDMI input for your video connection needs and two built-in 2.5-watt stereo speakers.

Viewsonic claims a native resolution of 1920x1200 and a dynamic contrast ratio of 6,000:1, which is a very high number. However there are reasons why you should not put too much stock into it. If I can get one in for testing, however, we'll see how close our contrast ratio test can come to that.

The display releases in July for $530.

Originally posted at Crave
June 23, 2008 7:00 AM PDT

Are FireWire connections crave-worthy?

by Dong Ngo
  • 8 comments

OK, I admit it. I want options, even though, most of the time I don't have much use for them. Take pocket-size external hard drives, for example. I want them to be compact, light, pretty, bus-powered, and especially I want them to support USB 2.0, FireWire 400, and FireWire 800. (I would take eSATA, too, though, that wouldn't make sense until it's bus-powered capable). However, the truth is, I've used mostly just the USB 2.0 connection for personal purposes. So today, I decided to find out if FireWire 400 and FireWire 800 are worth it, as far as the throughput is concerned.

In CNET Labs, like most devices, hard drives are tested in the "real world" approach. This means the test might not show the best of what the device can do, but how well it does in a real world situation. This is the reason why, if you have read the recent reviews of pocket-size external hard drives, you will see the margin in throughput between different hard drives or different connections of one hard drive are relatively small. Our 10GB test data consists of hundreds of folders and small files (resembling the content of a typical "My Documents" folder) that create a lot of overhead for the copying process.

I tweaked this test a bit for this experiment by using single 10GB file. We have only two pocket-size drives in CNET Labs that have all three types of connections: the OWC Mercury and the G-Tech G-Drive. I put them through the test and here are the scores (in Mbps):

(Credit: Dong Ngo/CNET Networks)

(Credit: Dong Ngo/CNET Networks)

So from the charts, there are three interesting revelations:

First, it doesn't matter what connection you use, with the same amount of data, it's faster to transfer when the data is in the form of a (few) large single file(s) than of multiple small files. This is another reason why you should compress your data into one single file (in ZIP or RAR, or any other types of compression format) before copying it onto another storage device, besides the apparent fact that compressing shrinks the size of the data itself. Of course, this only makes sense if you don't factor in the time needed for the compressing process.

Second, USB 2.0 is much slower than Firewire 400. Judging by the score, FireFire 400 could be up to 40 percent faster than USB 2.0. This is very interesting because on the specs; USB 2.0 is slated to have the transfer rate of up to 480Mbps, while that of FireWire 400 is only 400Mbps.

And last but not least, FireWire 800 is faster than FireWire 400 but not by a big margin, just a few percentages points, in writing. In reading, however, it's actually slower by about the same margin. This is also very interesting as FireWire 800 is slated to potentially offer twice the speed of FireWire 400.

So the conclusion is: yes FireWire connections are definitely worth it when it comes to speed, however, there's not much difference between the two. This means if your computer has a FireWire port, by all means, go ahead and get a drive that can take advantage of that. However, it' s pretty easy to decide which one to pick between FireWire 400 and FireWire 800: either one is fine.

A little disclaimer: these findings are only applicable to external pocket-size bus-powered hard drives working with a Windows XP machine. Full-size external hard drives with separate power adapters might yield different performance patterns.

In the end, personally, I still want my drive to support all these three connections, though I might just continue to use just the USB 2.0. But that's just me.

June 11, 2008 3:19 PM PDT

Testing tool helps evaluate high-end displays

by Eric Franklin
  • 2 comments
VM-2DVI

The Kramer VM-2DVI

(Credit: Kramer Electronics)

A couple months back I attempted to test two 30-inch displays--the Samsung SyncMaster 305T and the Gateway XHD3000 Extreme HD-- at the same time using CNET Labs' current distribution amplifier (DA), the Extron Electronics D2 DA4 DVI D2 DA4 DVI. This device allows up to four displays to simultaneously view the same video signal from one system. For years we've used this device to not only speed up testing, but to do accurate direct comparisons as well. Unfortunately the native resolution for the aforementioned 30-inchers is 2,560x1,600, and the maximum resolution the Extron supports is only 1,920x1,200. So, without a means to test them simultaneously at their native resolutions I was stuck in a bind. I could have tested them one at a time, but since our testing--which includes DisplayMate--has a high level of subjectivity to it, it's always best to do direct simultaneous comparisons, instead of testing one display today and then waiting a couple days to test the next. Testing them simultaneously allows you to see the exact differences between the displays.

So I delayed the testing and the review for a few weeks. In the meantime I got in touch with a colleague at DisplayMate, Ray Soneira. He put me in contact with a company called Kramer. Kramer manufactures a number of distribution amplifiers including the Kramer VM-2DVI. This particular DA is Dual Link compatible and supports each 30-inch display's 2560x1600 resolution. So now I could test both 30-inch displays simultaneously at their native resolutions in DisplayMate and in our current games test, World of Warcraft. However whenever I attempted to run either our Kill Bill Vol. 1 DVD or our Swordfish BD on both displays at the same time, the DRM gods reared their ugly heads and denied me salvation. So when testing how each display handles disc-based movies, I was forced to evaluate each display one at a time. The Kramer VM-2DVI is not advanced enough to circumvent DRM tomfoolery, unfortunately. That said, we're still very pleased that the VM-2DVI allowed us to do the bulk of our testing as fairly and accurately as possible.

The issue of not being able to view certain disc-based movies simultaneously on two or more displays may not be an issue for long, as CNET Labs is considering moving away from using movies--and even games-- to evaluate the quality of a display. The reason being that video images generally move too quickly to do a picture quality comparison, whereas static images such as high-quality photos can be studied as long as necessary in order to examine their quality. No decision has been made as yet, though, but look for more on this in a future Inside CNET Labs post. ... Read more

The following products mentioned are available.

On Sale Now: $1,149.95 - $1,309.99
View the latest prices for Samsung SyncMaster 305T LCD Monitor

  • prev
  • 1
  • next
Subscribe to the Inside CNET Labs podcast

Subscribe to this podcast using an RSS reader other than iTunes

Subscribe to this podcast using iTunes

View all Inside CNET Labs episodes
advertisement

About Inside CNET Labs Podcast

"Inside CNET Labs" has two meanings. First, this podcast takes you behind the scenes of CNET's editorial process from a performance testing perspective. It will demystify CNET's performance testing process, allowing the listener an inside look at the good, the bad, and the ugly of performance testing. The second meaning gets equal attention--and sometimes more so--as we go inside the heads of CNET's San Francisco Labs staff, Eric Franklin and Dong Ngo, who will have opinionated discussions on subjects ranging from the insecurities of people to whether the existence of time can be proven. This is the stuff they've talked about every day for several years. Unfortunately for them (and fortunately for you, we hope), it's now being recorded.

Email us at insidecnetlabs@cnet.com.


Add this feed to your online news reader

Inside CNET Labs Podcast topics

More on Inside CNET Labs
CNET Labs posts in Crave blog
Dong Ngo's posts in Crave blog
How we test
The hosts of Inside CNET Labs
Eric Franklin Eric Franklin's colleagues once had the following to say to him: "Eric, you've been doing this performance testing thing for over 10 years now. How about you try something different?" To which Eric responded, "How about you shut the #%$@! up?" This candid attitude allows him to go toe-to-toe with the most extreme of personalities, including that of Dong Ngo. This bio was written by Eric Franklin.
Dong Ngo Dong Ngo is a knowledgeable, opinionated individual who wants to convince the world that he's just a normal person; but he hasn't had much success. According to him, this is because the world itself is abnormal. Dong loves traveling and is well-versed in several languages. He, unfortunately, is not so well-versed in English. Still, it's best to ask him questions. From networking and how to optimize your system, to turning a strange place into home or what the meaning of life is…most of the time, he has the answers. The question is: Will he make himself understood? Subscribe and find out!

Most Discussed