X

Does your reality need augmenting? Try these apps

Until we have electronic contact lenses, this is the next best thing: iPhone and Android users get augmented reality apps.

Rafe Needleman Former Editor at Large
Rafe Needleman reviews mobile apps and products for fun, and picks startups apart when he gets bored. He has evaluated thousands of new companies, most of which have since gone out of business.
Rafe Needleman
3 min read
A contact lens with metal circuit elements has been tested in rabbits. University of Washington

Reading the news about a University of Washington professor's experimental electronic contact lens, I wondered if my dream of the ultimate personal technology has finally moved from over the horizon to in sight. Here's what I want: to be able to walk into crowded cocktail party, and know exactly who I am looking at -- each person's name, last time we met, and other information pertinent for a pleasant social interaction. I want that information beamed into my field of vision, in text floating over their heads, like the health indicators over the bad guys in a computer game.

It'll be awhile, though. The contact lens just has one blinky light in it so far. But you can now get augmented reality apps for the most modern mobile phones. New smartphones have not just cameras and location sensors (global positioning satellite receivers) but also compasses and inclinometers, so they know what direction they're pointing and which way the device is being held. With these sensors, they can run cool sci-fi apps that show data projected on top of the video their cameras are picking up.

In other words, augmented reality apps show, as their baseline image, a video of what the camera is pointing at, which is a redundant display of what you can see already with your own eyes. Then, on top of that, they overlay data -- graphics or text -- telling you about what the camera is seeing. Until smartphones are smart enough to recognize people by their faces, the cocktail party application I want isn't quite possible. Although it should be noted that Google and other companies do have face recognition functions in some of their photo album services, and a Swedish company called The Astonishing Tribe has a compelling demo of such a product. There's a video here.

But here's what you can do right now with a AR-capable phone:

Yelp shows you what's outside your window. Screenshot by Scott Stein/CNET

Get Yelp on the iPhone 3GS (download). A secret feature (shake the phone three times to activate it when Yelp is running) overlays restaurant names and user ratings over the video you're looking at. So you can see, in theory, a review score hovering over the image of the restaurant you're standing right outside of.

Get Layar for an Android Phone. Layar is a building block AR platform that can use data sets from other providers. There's Yelp, for example (although the pure Yelp iPhone app is a bit better). Layar can also show you Twitter posts from users nearby, Wikipedia entries based on what your camera is pointing at, houses for sale from Trulia, and other info. It's incredibly cool.

Lost in a strange city? If it's New York or London, try AcrossAir's subway locators that'll tell you just where the station you're looking for is.

Unfortunately, for the urban apps I just mentioned, sometimes the orientation sensors aren't as accurate as you'd like, and the data that you see is placed erroneously. I guess it's hard to get a reliable compass reading in a modern city setting. Also, the AR apps can't tell, yet, if what the camera is seeing is relevant to what they want to display. The Yelp app will often pop a review up over a building that's located between you and the building it means to display its info over.

The most interesting and useful augmented reality app I've tried so far (but keep in mind, I'm a geek) is Google Sky Map for the Android phone. When you're out in a field at night, far from lights and magnetic interference -- and assuming you still have a data connection -- your Android phone can tell you what stars or planets you're looking at. Better yet, ask it where a body like Mars is, and it'll tell you which way to point your phone until you're looking right at it. I'd like the app to have more data, to find things like the International Space Station, but it's still an amazing product. It makes me look like a genius to my son, and that's worth the price of admission. (It's a free app, so it's an easy calculation.)

If you want a phone capable of running AR apps, the choices today are be the iPhone 3GS (not the older 3G, it doesn't have a compass) or an Android phone like the MyTouch 3G.

And here's a tip: Until we're all set up with cocktail party implants, if you meet me at a party, do me a favor and introduce yourself the old-fashioned way.