Want CNET to notify you of price drops and the latest stories?
X

Before new camera tricks land on phones, they start here (pictures)

Have you ever wondered where the next smartphone camera feature gets developed and tested? CNET went to Qualcomm's offices in San Diego, Calif., for a look around the imaging labs.

qc-cam-lab-1.jpg
1 of 20 Jessica Dolcourt/CNET

Make yourself comfy

The making of cutting-edge camera features and tools starts here, in Qualcomm's photo and imaging lab, where teams test computer vision and artificial intelligence.

qc-cam-lab-2.jpg
2 of 20 Jessica Dolcourt/CNET

The reference design

Engineering vice president Serafin Diaz shows off the reference tablet that Qualcomm mocked up for testing and perfecting 3D scanning of the living room.

qc-cam-lab-4.jpg
3 of 20 Jessica Dolcourt/CNET

Ready? Let's scan

Diaz starts panning around the room, watching the shaded portions fill in. Depth sensors give this software its 3D capabilities.

qc-cam-lab-5.jpg
4 of 20 Jessica Dolcourt/CNET

Rotate

A bluish tint shows the scan's progress (this takes time). Meanwhile, Diaz shows how he can rotate the model within the interface. If you miss a spot, you can go back.

qc-cam-lab-6.jpg
5 of 20 Jessica Dolcourt/CNET

What it means for you

Scans of interiors are accurate, Diaz says, which makes this type of program ideal for remodeling and other architectural work.

qc-cam-lab-7.jpg
6 of 20 Jessica Dolcourt/CNET

Kids these days

"Kids are three-dimensionally-aware," Diaz said. "I believe the next generation is going to demand these kinds of features on their mobile devices."

qc-cam-lab-3.jpg
7 of 20 Jessica Dolcourt/CNET

Extra circuitry

It isn't pretty, but you can see the mods that help make this demo work on a Qualcomm chip.

Even if a device has a Qualcomm chip to support 3D imaging like this, electronics makers will have to decide if they want to use the features in their products.

qc-cam-lab-8.jpg
8 of 20 Jessica Dolcourt/CNET

3D object scans

This next demo scans the space for planes, like walls and tabletops. It can then compute the volume of objects in the space, which would be ideal for a device like a robot to have, so it can interact with those objects or avoid them.

qc-cam-lab-11.jpg
9 of 20 Jessica Dolcourt/CNET

The robot room

You can't rely on humans to test algorithms, Diaz said.

qc-cam-lab-9.jpg
10 of 20 Jessica Dolcourt/CNET

Robot arm

You need precise, repeatable motions. Hence, this robotic arm, which follows a set of complex directions to test 3D tracking.

qc-cam-lab-12.jpg
11 of 20 Jessica Dolcourt/CNET

Close up

The robot in question wields a smartphone in its clutches.

qc-cam-lab-10.jpg
12 of 20 Jessica Dolcourt/CNET

Keep a human on hand

The labs' human occupants still maintain override control and perform some individual tests as well.

qc-cam-lab-13.jpg
13 of 20 Jessica Dolcourt/CNET

Artificial intelligence smarts

Zeroth sounds like a comic book villain, but is actually a platform for running AI imaging functions.

qc-cam-lab-14.jpg
14 of 20 Jessica Dolcourt/CNET

Smart sorting

This gallery is really cool. You can find photos by attributes such as clouds, sunrises, indoor, party -- all from the device. The gallery won't waste time consulting the cloud.

qc-cam-lab-15.jpg
15 of 20 Jessica Dolcourt/CNET

What is this?

The camera can look at live objects, like these flowers, and adjust settings to take the best photo. It also automatically tags the images.

qc-cam-lab-17.jpg
16 of 20 Jessica Dolcourt/CNET

Photos, too

In addition to accurately describing real-life objects, this Zeroth camera can break down photos of scenes as well.

qc-cam-lab-16.jpg
17 of 20 Jessica Dolcourt/CNET

More tags

The tags on this picture are easier to see: car, outdoors, no people. Well, maybe it needs a little more work. Remember, this is still a demo. The final version will tag in the background.

qc-cam-lab-18.jpg
18 of 20 Jessica Dolcourt/CNET

Face detection

The camera will also try to auto-tag people it knows by faces it sees, meaning that you can search photos by looking for a person's name.

qc-cam-lab-19.jpg
19 of 20 Jessica Dolcourt/CNET

Handwriting recognition

Optical character recognition is a tough nut to crack. This one reads and converts handwriting, not just printed text.

qc-cam-lab-20.jpg
20 of 20 Jessica Dolcourt/CNET

Overlay

Converted text overlays the original handwritten note here. You can slide your finger to see both views. Imagine taking a photo of a whiteboard, then later searching through the digitized text.

Want more? See how magnetic fields make wireless charging a whole lot cooler.

More Galleries

New EX30 Is Volvo's Smallest, Quickest Electric SUV
Volvo EX30 compact electric SUV debuts

New EX30 Is Volvo's Smallest, Quickest Electric SUV

31 Photos
3-Row VW ID Buzz Electric Microbus Is Headed to the States in 2024
Volkswagen ID Buzz three-row EV

3-Row VW ID Buzz Electric Microbus Is Headed to the States in 2024

47 Photos
Take a Look at Wing's Auto-Loading Drone Delivery System
Wing marketing chief Jonathan Bass shows how a store employee hooks a package onto the autoloader to await drone pickup

Take a Look at Wing's Auto-Loading Drone Delivery System

13 Photos
Yamaha motorcycle and instrument designers trade jobs (pictures)
yamaha01.jpg

Yamaha motorcycle and instrument designers trade jobs (pictures)

16 Photos
CNET's 'Day of the Dead Devices' altar (pictures)
dia-de-los-muertos-3318-001.jpg

CNET's 'Day of the Dead Devices' altar (pictures)

9 Photos
2007 Los Angeles Auto Show: concept cars
conceptss01_440.jpg

2007 Los Angeles Auto Show: concept cars

14 Photos
Best sound bars under $300
polk-magnifi-mini-15.jpg

Best sound bars under $300

18 Photos