How Oculus VR is ditching controllers for your hands
[MUSIC]
And I can see my hand.
I'm being instructed to poke the dragon's tummy, yellow vomit goes in the bucket.
I'm pointing at it, I can see my hands pointing at it.
And now I've got these giant dragon claws.
So my hands transformed again, if I make a fist with them, Giant Wolverine spikes pop out of my hand.
I've been looking at VR demos for years.
I remember looking at a lot of oculus demos going back to CS as of the past, and the Oculus Rift.
Facebook's VR headset came out in 2016.
I remember using those Touch controllers and thinking there was amazing how they transform spaces.
Well this year Facebook is trying to dive into AR technologies but in the moment they're looking at incorporating hands into VR.
It could be the stepping stone to what comes next.
I've done hand tracking before in VR and in AR.
I've used hand tracking in a lot of site specific experiences that are almost like theater at places like the Tribeca film Festival.
Leap Motion had some hand tracking that you could use in VR headsets as well.
Hand tracking an AR is incorporated by both Magic Leap and Microsoft's HoloLens.
And earlier this year, I use my hands to manipulate holograms that were floating in front of me with a pulldown visor.
What's interesting about what Facebook is doing with Oculus quest is there putting that hand tracking into a $400 standalone VR headset Which costs a lot less than one of those high end VR headsets.
I tried a few demos here, Facebook's headquarters, and they worked.
They weren't quite as smooth as what I would get out of touch controllers.
But I was able to reach out my hands and it could recognize my finger motions.
I could give thumbs up, I could do this.
I could do that.
I could do that.
I could basically do anything I wanted with my hands.
[MUSIC]
And there were two different demos that I tried.
One was set in a magical lab that felt like a game that I could play with turning my hands into various monster hands.
And the other one was an Enterprise demo, where I got to.
Explore being an insurance evaluator to see what sort of water damage was in the kitchen.
The hand tracking is using the four cameras that the Oculus quest has, which aren't the most complicated camera setup but there's no depth sensing after Apparatus user.
These are four black and white cameras that are providing enough information to pull out the computer vision processing to make this work.
You could imagine that down the road you could have more advanced cameras that will do that and even more enhanced way.
Facebook is going to incorporate hand tracking into the Oxylus quest early next year.
And open up an SDK so that other people can play around with developing apps for it.
Maybe it'll come to the Oculus Rift as well, that's unclear.
But one thing that has to be cracked is inputs.
Not just feeling something, but also being able to connect Can control things and not have to have a lot of apparatus.
This hand tracking, Facebook has said, could be used not just in the Quest, but you can imagine in other devices.
Maybe in something like Portal where you're standing in front of a magic mirror and then you're using your hands.
When I started trying hand tracking in the Oculus Quest, I started thinking about those AR headsets.
How do I do this and see stuff in the real world?
Could I use the pass through cameras to potentially grab something and move it around my living room?
That's not here yet.
It could be.
But it looks like hand tracking is the beginning of that bridge from VR to AR.
And it looks like Facebook is trying to make that move here, starting at their Oculus Connect conference.
Facebook's Horizon Workrooms: A VR office app you can bring your laptop into
Up Next
Facebook's Horizon Workrooms: A VR office app you can bring your laptop into
Google reveals 3D video chat with Project Starline
Google reveals 3D video chat with Project Starline
Watch Simone Biles interact with AR Simone Biles
Watch Simone Biles interact with AR Simone Biles
Mark Zuckerberg talks to CNET about the future of VR, fitness, Quest Pro and a Facebook metaverse
Mark Zuckerberg talks to CNET about the future of VR, fitness, Quest Pro and a Facebook metaverse
Are you ready to bring your augmented reality office home with you?
Are you ready to bring your augmented reality office home with you?
We break down the future of AR (The Daily Charge, 2/20/2020)
We break down the future of AR (The Daily Charge, 2/20/2020)
What your future VR/AR goggles could do with Qualcomm's new XR2 chip
What your future VR/AR goggles could do with Qualcomm's new XR2 chip
Zuckerberg shows off Oculus Quest hand tracking
Zuckerberg shows off Oculus Quest hand tracking
Zuckerberg announces Facebook Horizon VR social media platform
Zuckerberg announces Facebook Horizon VR social media platform
How Oculus VR is ditching controllers for your hands
How Oculus VR is ditching controllers for your hands
Tech Shows
The Apple Core
The Apple Core
Alphabet City
Alphabet City
CNET Top 5
CNET Top 5
The Daily Charge
The Daily Charge
What the Future
What the Future
Tech Today
Tech Today
Cooley On Cars
Cooley On Cars
Carfection
Carfection
The Apple Core
The Apple Core
Alphabet City
Alphabet City
CNET Top 5
CNET Top 5
The Daily Charge
The Daily Charge
What the Future
What the Future
Tech Today
Tech Today
Cooley On Cars
Cooley On Cars
Carfection
Carfection
Latest News
Android 15: See New Features in Action
Android 15: See New Features in Action
If Apple Makes Siri Like ChatGPT or Gemini, I'm Done
If Apple Makes Siri Like ChatGPT or Gemini, I'm Done
Bose SoundLink Max Review: How Does It Compare to the Cheaper SoundLink Flex?
Bose SoundLink Max Review: How Does It Compare to the Cheaper SoundLink Flex?
Hands-On With Huawei's Pura 70 Ultra
Hands-On With Huawei's Pura 70 Ultra
I Tried Three Fitness Apps to Help My Postpartum Recovery
I Tried Three Fitness Apps to Help My Postpartum Recovery
How Many Times Did Google Say AI at I/O 2024?
How Many Times Did Google Say AI at I/O 2024?
I Tried Google's Project Astra
I Tried Google's Project Astra
Everything Google Just Announced at I/O 2024
Everything Google Just Announced at I/O 2024
Google Introduces Gemini AI Upgrades to Gmail and Chat
Google Introduces Gemini AI Upgrades to Gmail and Chat
Google Brings Multistep Reasoning to Search
Google Brings Multistep Reasoning to Search
Android 15: See New Features in Action
Android 15: See New Features in Action
If Apple Makes Siri Like ChatGPT or Gemini, I'm Done
If Apple Makes Siri Like ChatGPT or Gemini, I'm Done
Bose SoundLink Max Review: How Does It Compare to the Cheaper SoundLink Flex?
Bose SoundLink Max Review: How Does It Compare to the Cheaper SoundLink Flex?
Hands-On With Huawei's Pura 70 Ultra
Hands-On With Huawei's Pura 70 Ultra
I Tried Three Fitness Apps to Help My Postpartum Recovery
I Tried Three Fitness Apps to Help My Postpartum Recovery
How Many Times Did Google Say AI at I/O 2024?
How Many Times Did Google Say AI at I/O 2024?
I Tried Google's Project Astra
I Tried Google's Project Astra
Everything Google Just Announced at I/O 2024
Everything Google Just Announced at I/O 2024
Google Introduces Gemini AI Upgrades to Gmail and Chat
Google Introduces Gemini AI Upgrades to Gmail and Chat
Google Brings Multistep Reasoning to Search