X

In-car monitoring: Surveillance tech will make your car less private

Everything you do in your car may soon be noticed.

Brian Cooley Editor at Large
Brian Cooley is CNET's Editor at large and has been with the brand since 1995. He currently focuses on electrification of vehicles but also follows the big trends in smart home, digital healthcare, 5G, the future of food, and augmented & virtual realities. Cooley is a sought after presenter by brands and their agencies when they want to understand how consumers react to new technologies. He has been a regular featured speaker at CES, Cannes Lions, Advertising Week and The PHM HealthFront™. He was born and raised in Silicon Valley when Apple's campus was mostly apricots.
Expertise Automotive technology, smart home, digital health. Credentials
  • 5G Technician, ETA International
Brian Cooley
3 min read
vlcsnap-2019-03-08-09h26m45s217

TI's millimeter wave radar for cars can be mounted on a headliner, near a rear view mirror or in the back of a seat. It can detect people inside and outside the car.

Texas Instruments

Your car has long been a sanctuary on wheels but that won't be true for much longer. Car manufacturers will soon be adding radar and lasers inside the cabin to monitor who you are and what you do, and that will mean even more of your personal habits being tracked. 

Millimeter-wave radar is perhaps the most intriguing in-car detection tech. The apparatus itself can be compact because its frequency is so high and therefore its emitted wavelength is short. I've seen several examples about the size of a card deck that could easily be mounted on the headliner of a car and look down at its cabin. Texas Instruments has been showing carmakers how that view can not only detect objects in the vehicle but also classify them as an adult, a child or even a dog.

Watch this: Cars increase their in-cabin surveillance

Mount that same radar inside a seat and you can detect small movements in the driver's body that, with enough computing power, can be translated into a reading of respiration rate. 

Startup Caaresys imagines its radar-based system monitoring the respiration and heart rates of everyone in the car, with a particular focus on sensing a child that might be hidden from view in the back and potentially left behind in the car.

vlcsnap-2019-03-08-09h27m14s368

Classification and detection may soon enter a dramatic new era. Startup Caaresys envisions its in-car radar as much more than a mere occupant detection system.

Caaresys

Unlike other smart sensing scenarios, like an Amazon Go store where cameras dominate, car interiors are cramped and filled with obstructions like seats. Radar has the benefit of being able to see through a lot of things that block a camera's view. And while much of the current work is aimed at human-driven cars, the same radar technology could detect passenger orientation in future self-driving cars, which may not always be facing forward. Airbags and other passive safety systems could use smart radar sensing to configure themselves in a crash based on who is facing which direction.  

Even biometrics that aren't necessarily gathered by the car can be used to monitor you. BSecur said each of us has a unique ECG/EKG signature that can be used to unlock a car or monitor our condition while driving. That heart pattern could be tracked for the car's processors by sensors in the steering wheel or via a smartwatch.

vlcsnap-2019-03-08-09h25m58s570

It's about time we have cars that won't let themselves door a cyclist. Brose and Vayyar are working on radar systems that will sense where a door should swing to and prevent it from going any farther.

Brose

Not all car-cabin radar is about our bodies and faces: Vayyar is working with auto mechatronics company Brose to sense obstacles in the path of a car door, including nearby poles, walls, cyclists or other parked cars, and then block the door from opening too far via a limiter. That's bad news for paintless dent-removal guys, but great news for cyclists who live in fear of being doored.

Radar is far from the only game in town though. Cameras are already used in a few cars to monitor a driver's gaze and eye state for inattention and drowsiness. The Cadillac CT6 pushed this envelope with its Super Cruise partial autonomy that watches the driver's face to determine if they are looking away from the road for too long. A huge number of similar applications are about to arrive from Mazda, Hyundai, Kia, BMW and autonomous EV startup Byton.     

vlcsnap-2019-03-08-09h27m49s574

Face monitoring via vertical-cavity surface-emitting lasers VCSEL is basically Apple FaceID for cars.

Trilumina

Joining cameras in the car may be vertical-cavity surface-emitting lasers (VCSEL), the same tech that powers Apple FaceID. Makers like TriLumina are showing how it can tell an occupant's state, identity and maybe even intent. 

Finally, there's gesture control which today is little more than a parlor trick, sensing only a few big, coarse gestures that don't even work half the time. But Google's Project Soli recently won FCC approval to use millimeter-wave radar to pick up fine gestures with a level of nuance that could finally liberate controls from screens, knobs and voice in a way that is better, not just amusing.

soli

Google's Project Soli isn't limited to cars, but its potential to bring fine resolution gesture detection to them is intriguing.

Google