How Oculus VR is ditching controllers for your hands
3:24

How Oculus VR is ditching controllers for your hands

Virtual Reality Apps
[MUSIC] And I can see my hand. I'm being instructed to poke the dragon's tummy, yellow vomit goes in the bucket. I'm pointing at it, I can see my hands pointing at it. And now I've got these giant dragon claws. So my hands transformed again, if I make a fist with them, Giant Wolverine spikes pop out of my hand. I've been looking at VR demos for years. I remember looking at a lot of oculus demos going back to CS as of the past, and the Oculus Rift. Facebook's VR headset came out in 2016. I remember using those Touch controllers and thinking there was amazing how they transform spaces. Well this year Facebook is trying to dive into AR technologies but in the moment they're looking at incorporating hands into VR. It could be the stepping stone to what comes next. I've done hand tracking before in VR and in AR. I've used hand tracking in a lot of site specific experiences that are almost like theater at places like the Tribeca film Festival. Leap Motion had some hand tracking that you could use in VR headsets as well. Hand tracking an AR is incorporated by both Magic Leap and Microsoft's HoloLens. And earlier this year, I use my hands to manipulate holograms that were floating in front of me with a pulldown visor. What's interesting about what Facebook is doing with Oculus quest is there putting that hand tracking into a $400 standalone VR headset Which costs a lot less than one of those high end VR headsets. I tried a few demos here, Facebook's headquarters, and they worked. They weren't quite as smooth as what I would get out of touch controllers. But I was able to reach out my hands and it could recognize my finger motions. I could give thumbs up, I could do this. I could do that. I could do that. I could basically do anything I wanted with my hands. [MUSIC] And there were two different demos that I tried. One was set in a magical lab that felt like a game that I could play with turning my hands into various monster hands. And the other one was an Enterprise demo, where I got to. Explore being an insurance evaluator to see what sort of water damage was in the kitchen. The hand tracking is using the four cameras that the Oculus quest has, which aren't the most complicated camera setup but there's no depth sensing after Apparatus user. These are four black and white cameras that are providing enough information to pull out the computer vision processing to make this work. You could imagine that down the road you could have more advanced cameras that will do that and even more enhanced way. Facebook is going to incorporate hand tracking into the Oxylus quest early next year. And open up an SDK so that other people can play around with developing apps for it. Maybe it'll come to the Oculus Rift as well, that's unclear. But one thing that has to be cracked is inputs. Not just feeling something, but also being able to connect Can control things and not have to have a lot of apparatus. This hand tracking, Facebook has said, could be used not just in the Quest, but you can imagine in other devices. Maybe in something like Portal where you're standing in front of a magic mirror and then you're using your hands. When I started trying hand tracking in the Oculus Quest, I started thinking about those AR headsets. How do I do this and see stuff in the real world? Could I use the pass through cameras to potentially grab something and move it around my living room? That's not here yet. It could be. But it looks like hand tracking is the beginning of that bridge from VR to AR. And it looks like Facebook is trying to make that move here, starting at their Oculus Connect conference.

Up Next

Facebook's Horizon Workrooms: A VR office app you can bring your laptop into
markzuckerberg-collaboration-space-mp4-00-00-23-00-still001

Up Next

Facebook's Horizon Workrooms: A VR office app you can bring your laptop into

Google reveals 3D video chat with Project Starline
starline-thumbnail

Google reveals 3D video chat with Project Starline

Watch Simone Biles interact with AR Simone Biles
simone-biles-google

Watch Simone Biles interact with AR Simone Biles

Mark Zuckerberg talks to CNET about the future of VR, fitness, Quest Pro and a Facebook metaverse
zuckerberg-audiowaves1

Mark Zuckerberg talks to CNET about the future of VR, fitness, Quest Pro and a Facebook metaverse

Are you ready to bring your augmented reality office home with you?
scott-spatial

Are you ready to bring your augmented reality office home with you?

We break down the future of AR (The Daily Charge, 2/20/2020)
dc02202020

We break down the future of AR (The Daily Charge, 2/20/2020)

What your future VR/AR goggles could do with Qualcomm's new XR2 chip
p1000199

What your future VR/AR goggles could do with Qualcomm's new XR2 chip

Zuckerberg shows off Oculus Quest hand tracking
oculus-quest-hand-tracking-2

Zuckerberg shows off Oculus Quest hand tracking

Zuckerberg announces Facebook Horizon VR social media platform
facebook-horizon

Zuckerberg announces Facebook Horizon VR social media platform

Tech Shows

The Apple Core
apple-core-w

The Apple Core

Alphabet City
alphabet-city-w

Alphabet City

CNET Top 5
cnet-top-5-w

CNET Top 5

The Daily Charge
dc-site-1color-logo.png

The Daily Charge

What the Future
what-the-future-w

What the Future

Tech Today
tech-today-w

Tech Today

Latest News All latest news

How Stationary Batteries Could Help Your Electric Car Move
chargebox-ads-etron-4165x2777

How Stationary Batteries Could Help Your Electric Car Move

Microsoft Surface Laptop Go 2 Video Review
surface-go-22

Microsoft Surface Laptop Go 2 Video Review

What iOS 16 May Tell Us About the iPhone 14
yt-appleslice-iphone-14cnet

What iOS 16 May Tell Us About the iPhone 14

MacBook Pro M2: Apple's New Chip Put to the Test
p1099021-mov-03-56-58-06-still001

MacBook Pro M2: Apple's New Chip Put to the Test

Bring a Little Glamp to Your Camping Trip With These Portable Power Stations
1202484230753671-btat6xklmc41i6ujbdbz-height640.png

Bring a Little Glamp to Your Camping Trip With These Portable Power Stations

Apple Will Have to Add USB-C to iPhones Because of This Legislation
220620-yt-usb-c-explainer-site

Apple Will Have to Add USB-C to iPhones Because of This Legislation

Most Popular All most popular

What's New to Stream for June 2022
netpicks-june-2022thumb

What's New to Stream for June 2022

What iOS 16 May Tell Us About the iPhone 14
yt-appleslice-iphone-14cnet

What iOS 16 May Tell Us About the iPhone 14

Microsoft Surface Laptop Go 2 Video Review
surface-go-22

Microsoft Surface Laptop Go 2 Video Review

SpyraTwo hands-on: The ultimate water gun
spyratwo-2

SpyraTwo hands-on: The ultimate water gun

MacBook Pro M2: Apple's New Chip Put to the Test
p1099021-mov-03-56-58-06-still001

MacBook Pro M2: Apple's New Chip Put to the Test

Apple Will Have to Add USB-C to iPhones Because of This Legislation
220620-yt-usb-c-explainer-site

Apple Will Have to Add USB-C to iPhones Because of This Legislation

Latest Products All latest products

E Ink Tablets: Everything You Need to Know
eink-website

E Ink Tablets: Everything You Need to Know

Moto G 5G Review: A $400 Phone That May Have Everything You Need
clip0001-00-00-25-15-still001

Moto G 5G Review: A $400 Phone That May Have Everything You Need

Hands-On: We Got to Try the Sony Xperia 1 IV and Its Zoom Lens
xperiafinalpicsite

Hands-On: We Got to Try the Sony Xperia 1 IV and Its Zoom Lens

Lenovo Legion 7 Gaming Laptops Combine Great Power With Simple, Slim Designs
lenovolegion-00-00-45-13-still003

Lenovo Legion 7 Gaming Laptops Combine Great Power With Simple, Slim Designs

Exploring Meta Store: Facebook Parent Meta's First Physical Retail Space
metastore

Exploring Meta Store: Facebook Parent Meta's First Physical Retail Space

Lenovo's Torrent of Slim-Series Laptops Has Almost Too Many Options
lenovoslim-00-00-03-10-still001.png

Lenovo's Torrent of Slim-Series Laptops Has Almost Too Many Options

Latest How To All how to videos

How to Delete or Disable Your Instagram Account
phoneonorange

How to Delete or Disable Your Instagram Account

Fix Your iPhone Screen With Apple's Self-Service Repair Kit
dsc00641

Fix Your iPhone Screen With Apple's Self-Service Repair Kit

How to Buy a Budget Laptop in 2022
budgetlaptops-00-08-35-15-still001

How to Buy a Budget Laptop in 2022

Google Pay: How to Set Up and Use
googlepay-inhand

Google Pay: How to Set Up and Use

Clean Your AirPods and EarPods Without Damaging Them
yt-howto-clean-airpods-v3

Clean Your AirPods and EarPods Without Damaging Them

How to Control Your Computer With Your Feet
yt-learn-guitar-foot-controls-v2

How to Control Your Computer With Your Feet