Oculus discusses Crescent Bay and future of VR
[MUSIC]
So what does it take to do virtual reality right?
As it turns out, virtual reality doesn't have to replicate the real world in order to work.
It just has to provide the right inputs in order to satisfy the relevant sensors and drive, drive the correct inference.
To paraphrase Morpheus, some rules can be bent.
Others can be broken.
For example, many of you will get to experience the demo of the latest iteration of the Rift, Crescent Bay during F8.
When you do, I'm confident that most of you will feel like you've been teleported into a virtual world, like you're literally there.
And yet when you're using crescent bay you're looking at photons coming from pixel strobed at 90 hertz rather than photons continuous arriving from real world surfaces and lights.
That works because the periods during which the receptive fields on the retina accumulate photons is about 20 milliseconds.
And the structure of those fields is such that they'll respond just as well to the photons arriving in several short bursts, as they do to them arriving continuously from real world surfaces.
Drop the frame rate to 60 hertz, however, and those same receptive fields will start to detect quicker.
Drop it to 10 hertz, and motion will cease to appear smooth.
IN fact, present day display system differs from the real world in many ways.
But by taking advantage of the physiology of the visual system, it none the less produces the desired signals to the brain.
So part of making virtual reality work is learning how our sensors can and can't be driven to send the right signals to the brain.
The other, less obvious part, is learned what it takes to get the brain to make a desired inference.
For example, remember this?
We were able to get the brain to infer in the corresponding head movement by leveraging the convexity of something.
The same sort of thing is required in a general sense for VR to work, and the key to that is agreement between multiple sensors and our internal model of reality, especially when it involves feedback loops.
For many people, the defining moment in the Crescent Bay demo is finding themselves on the edge of a long drop.
The response is often to grab a nearby virtual pipe.
Which shows that enough unconscious inference has kicked in to trigger the automatic responses to mean the, means the brain believes it's some place real.
Why does that happen?
While the scene we're kneeled, climbs out onto a ledge outside a building.
And looks down a thousand feet never makes anyone grab for support.
The difference is, that when you move your head in Crescent Bay, both the motion your vestibular organs report and the parallax or visual system report match the motor signals you sent your neck muscles.
And your sense of proprioception.
That is, your model of the position of your body.
And they do so with low enough latency so that your brain can fuse all those data points into a coherent model of the world.
At the core if this is a feedback loop.
You move your head and what you see changes correctly and with it almost imperceptible delay.
Allowing your brain to maintain the same kind of model of the virtual world as it does for the real world.
Which then leads smoothly to further motion.
That's the fundamental difference between movies and VR.
Movies provide similar images, but with no feedback loop for head motion.
As a result, we perceive movies as moving pictures on a flat surface, still firmly embedded in the real world.
Good VR, in contrast, isn't perceived as pictures at all.
It replaces, rather than augments, the real world.
VR is about driving our perceptions.
The way they're built to be driven.
If we can do that, it should be completely unsurprising that it enables us to create new realities.
If the technology becomes good enough, VR should theoretically be able in the limit, to create not only any experience that's possible in the real world, but any experience that we're capable of having
Up Next
Everything Just Revealed at Nvidia's GTC AI Conference
Up Next
Everything Just Revealed at Nvidia's GTC AI Conference
Nvidia Reveals Omniverse Cloud Streams to the Vision Pro
Nvidia Reveals Omniverse Cloud Streams to the Vision Pro
Nvidia Shows Project GROOT and Disney Bots at GTC Conference
Nvidia Shows Project GROOT and Disney Bots at GTC Conference
Expert vs. AI: Is Now the Time to Buy an EV?
Expert vs. AI: Is Now the Time to Buy an EV?
Apple Has Big Ideas for a Smart Ring
Apple Has Big Ideas for a Smart Ring
SpaceX's Starship 3rd Flight Attempt (Supercut)
SpaceX's Starship 3rd Flight Attempt (Supercut)
Apple Has Big AI Plans for Mac — and iPhone, Too
Apple Has Big AI Plans for Mac — and iPhone, Too
Apple Updates 13- and 15-Inch MacBook Air With M3 Chips
Apple Updates 13- and 15-Inch MacBook Air With M3 Chips
Apple Makes the Vision Pro Store Demo an Entertaining Ride
Apple Makes the Vision Pro Store Demo an Entertaining Ride
Apple Sports Is the Next Step in Apple's Big Sports Plans
Apple Sports Is the Next Step in Apple's Big Sports Plans
Tech Shows
Latest News All latest news
PlayStation 5 Pro Leaked: Everything We Know
PlayStation 5 Pro Leaked: Everything We Know
Everything Just Revealed at Nvidia's GTC AI Conference
Everything Just Revealed at Nvidia's GTC AI Conference
Nvidia Reveals Omniverse Cloud Streams to the Vision Pro
Nvidia Reveals Omniverse Cloud Streams to the Vision Pro
Nvidia Shows Project GROOT and Disney Bots at GTC Conference
Nvidia Shows Project GROOT and Disney Bots at GTC Conference
Expert vs. AI: Is Now the Time to Buy an EV?
Expert vs. AI: Is Now the Time to Buy an EV?
The PlayStation Portal Built-In Volume Is too Loud: Here's How to Keep It Low
The PlayStation Portal Built-In Volume Is too Loud: Here's How to Keep It Low
Most Popular All most popular
First Look at TSA's Self-Screening Tech (in VR!)
First Look at TSA's Self-Screening Tech (in VR!)
Samsung Galaxy S24 Ultra Review: More AI at a Higher Cost
Samsung Galaxy S24 Ultra Review: More AI at a Higher Cost
'Circle to Search' Lets Users Google From Any Screen
'Circle to Search' Lets Users Google From Any Screen
Asus Put Two 14-inch OLEDs in a Laptop, Unleashes First OLED ROG Gaming Laptop
Asus Put Two 14-inch OLEDs in a Laptop, Unleashes First OLED ROG Gaming Laptop
Samsung Galaxy Ring: First Impressions
Samsung Galaxy Ring: First Impressions
Best of Show: The Coolest Gadgets of CES 2024
Best of Show: The Coolest Gadgets of CES 2024
Latest Products All latest products
First Look: The $349 Nothing Phone 2A Aims to Brighten Your Day
First Look: The $349 Nothing Phone 2A Aims to Brighten Your Day
Best of MWC 2024: Bendable Screens, AI Wearables and More
Best of MWC 2024: Bendable Screens, AI Wearables and More
This Concept Laptop from Lenovo Has a Transparent Display
This Concept Laptop from Lenovo Has a Transparent Display
Motorola's Rollable Concept Phone Wraps on Your Wrist
Motorola's Rollable Concept Phone Wraps on Your Wrist
See Adobe Lightroom on the Apple Vision Pro
See Adobe Lightroom on the Apple Vision Pro
This $400 Cane Has a Built-In Phone
This $400 Cane Has a Built-In Phone
Latest How To All how to videos
Windows 11 Tips and Hidden Features
Windows 11 Tips and Hidden Features
Vision Pro App Walkthrough -- VisionOS 1.0.3
Vision Pro App Walkthrough -- VisionOS 1.0.3
Tips and Tricks for the Galaxy S24 Ultra
Tips and Tricks for the Galaxy S24 Ultra
TikTok Is Now on the Apple Vision Pro
TikTok Is Now on the Apple Vision Pro
Get Your TV Ready for the Big Game: Super Bowl Setup Tips
Get Your TV Ready for the Big Game: Super Bowl Setup Tips
How to Use a Quest 3 Like the Vision Pro