Oculus discusses Crescent Bay and future of VR
Oculus discusses Crescent Bay and future of VR
4:02

Oculus discusses Crescent Bay and future of VR

Culture
[MUSIC] So what does it take to do virtual reality right? As it turns out, virtual reality doesn't have to replicate the real world in order to work. It just has to provide the right inputs in order to satisfy the relevant sensors and drive, drive the correct inference. To paraphrase Morpheus, some rules can be bent. Others can be broken. For example, many of you will get to experience the demo of the latest iteration of the Rift, Crescent Bay during F8. When you do, I'm confident that most of you will feel like you've been teleported into a virtual world, like you're literally there. And yet when you're using crescent bay you're looking at photons coming from pixel strobed at 90 hertz rather than photons continuous arriving from real world surfaces and lights. That works because the periods during which the receptive fields on the retina accumulate photons is about 20 milliseconds. And the structure of those fields is such that they'll respond just as well to the photons arriving in several short bursts, as they do to them arriving continuously from real world surfaces. Drop the frame rate to 60 hertz, however, and those same receptive fields will start to detect quicker. Drop it to 10 hertz, and motion will cease to appear smooth. IN fact, present day display system differs from the real world in many ways. But by taking advantage of the physiology of the visual system, it none the less produces the desired signals to the brain. So part of making virtual reality work is learning how our sensors can and can't be driven to send the right signals to the brain. The other, less obvious part, is learned what it takes to get the brain to make a desired inference. For example, remember this? We were able to get the brain to infer in the corresponding head movement by leveraging the convexity of something. The same sort of thing is required in a general sense for VR to work, and the key to that is agreement between multiple sensors and our internal model of reality, especially when it involves feedback loops. For many people, the defining moment in the Crescent Bay demo is finding themselves on the edge of a long drop. The response is often to grab a nearby virtual pipe. Which shows that enough unconscious inference has kicked in to trigger the automatic responses to mean the, means the brain believes it's some place real. Why does that happen? While the scene we're kneeled, climbs out onto a ledge outside a building. And looks down a thousand feet never makes anyone grab for support. The difference is, that when you move your head in Crescent Bay, both the motion your vestibular organs report and the parallax or visual system report match the motor signals you sent your neck muscles. And your sense of proprioception. That is, your model of the position of your body. And they do so with low enough latency so that your brain can fuse all those data points into a coherent model of the world. At the core if this is a feedback loop. You move your head and what you see changes correctly and with it almost imperceptible delay. Allowing your brain to maintain the same kind of model of the virtual world as it does for the real world. Which then leads smoothly to further motion. That's the fundamental difference between movies and VR. Movies provide similar images, but with no feedback loop for head motion. As a result, we perceive movies as moving pictures on a flat surface, still firmly embedded in the real world. Good VR, in contrast, isn't perceived as pictures at all. It replaces, rather than augments, the real world. VR is about driving our perceptions. The way they're built to be driven. If we can do that, it should be completely unsurprising that it enables us to create new realities. If the technology becomes good enough, VR should theoretically be able in the limit, to create not only any experience that's possible in the real world, but any experience that we're capable of having

Up Next

Everything Just Revealed at Nvidia's GTC AI Conference
nvidiastill

Up Next

Everything Just Revealed at Nvidia's GTC AI Conference

Nvidia Reveals Omniverse Cloud Streams to the Vision Pro
nvidia-vision-pro-image

Nvidia Reveals Omniverse Cloud Streams to the Vision Pro

Nvidia Shows Project GROOT and Disney Bots at GTC Conference
robot-2

Nvidia Shows Project GROOT and Disney Bots at GTC Conference

Expert vs. AI: Is Now the Time to Buy an EV?
gettyimages-1178244881

Expert vs. AI: Is Now the Time to Buy an EV?

Apple Has Big Ideas for a Smart Ring
240314-yt-omt-apple-ring-v4

Apple Has Big Ideas for a Smart Ring

SpaceX's Starship 3rd Flight Attempt (Supercut)
spacexstarshiptestflight1

SpaceX's Starship 3rd Flight Attempt (Supercut)

Apple Has Big AI Plans for Mac — and iPhone, Too
240307-yt-omt-ai-siri-v03

Apple Has Big AI Plans for Mac — and iPhone, Too

Apple Updates 13- and 15-Inch MacBook Air With M3 Chips
macbookair-news-00-00-17-16-still002

Apple Updates 13- and 15-Inch MacBook Air With M3 Chips

Apple Makes the Vision Pro Store Demo an Entertaining Ride
240229-site-what-its-like-to-demo-vision-pro-v3

Apple Makes the Vision Pro Store Demo an Entertaining Ride

Apple Sports Is the Next Step in Apple's Big Sports Plans
240222-site-one-more-thing-apple-sports-v2

Apple Sports Is the Next Step in Apple's Big Sports Plans

Tech Shows

The Apple Core
apple-core-w

The Apple Core

Alphabet City
alphabet-city-w

Alphabet City

CNET Top 5
cnet-top-5-w

CNET Top 5

The Daily Charge
dc-site-1color-logo.png

The Daily Charge

What the Future
what-the-future-w

What the Future

Tech Today
tech-today-w

Tech Today

Latest News All latest news

PlayStation 5 Pro Leaked: Everything We Know
playstation5pro-leak-clean

PlayStation 5 Pro Leaked: Everything We Know

Everything Just Revealed at Nvidia's GTC AI Conference
nvidiastill

Everything Just Revealed at Nvidia's GTC AI Conference

Nvidia Reveals Omniverse Cloud Streams to the Vision Pro
nvidia-vision-pro-image

Nvidia Reveals Omniverse Cloud Streams to the Vision Pro

Nvidia Shows Project GROOT and Disney Bots at GTC Conference
robot-2

Nvidia Shows Project GROOT and Disney Bots at GTC Conference

Expert vs. AI: Is Now the Time to Buy an EV?
gettyimages-1178244881

Expert vs. AI: Is Now the Time to Buy an EV?

The PlayStation Portal Built-In Volume Is too Loud: Here's How to Keep It Low
playstation-portal-audio-options-thumb2

The PlayStation Portal Built-In Volume Is too Loud: Here's How to Keep It Low

Most Popular All most popular

First Look at TSA's Self-Screening Tech (in VR!)
innovation

First Look at TSA's Self-Screening Tech (in VR!)

Samsung Galaxy S24 Ultra Review: More AI at a Higher Cost
240123-site-samsung-galaxy-s24-ultra-review-4

Samsung Galaxy S24 Ultra Review: More AI at a Higher Cost

'Circle to Search' Lets Users Google From Any Screen
circlesearchpic

'Circle to Search' Lets Users Google From Any Screen

Asus Put Two 14-inch OLEDs in a Laptop, Unleashes First OLED ROG Gaming Laptop
asus-preces-00-00-25-11-still003

Asus Put Two 14-inch OLEDs in a Laptop, Unleashes First OLED ROG Gaming Laptop

Samsung Galaxy Ring: First Impressions
samsung-galaxy-ring-clean

Samsung Galaxy Ring: First Impressions

Best of Show: The Coolest Gadgets of CES 2024
240111-site-best-of-ces-2024-1

Best of Show: The Coolest Gadgets of CES 2024

Latest Products All latest products

First Look: The $349 Nothing Phone 2A Aims to Brighten Your Day
240304-site-nothing-phone-2-first-look-v3

First Look: The $349 Nothing Phone 2A Aims to Brighten Your Day

Best of MWC 2024: Bendable Screens, AI Wearables and More
240229-site-best-of-show-at-mwc

Best of MWC 2024: Bendable Screens, AI Wearables and More

This Concept Laptop from Lenovo Has a Transparent Display
240225-site-lenovo-translucent-laptop-concept-v3

This Concept Laptop from Lenovo Has a Transparent Display

Motorola's Rollable Concept Phone Wraps on Your Wrist
240225-site-motorola-rollable-concept

Motorola's Rollable Concept Phone Wraps on Your Wrist

See Adobe Lightroom on the Apple Vision Pro
adobe-lightroom-00-02-58-03-still006-1

See Adobe Lightroom on the Apple Vision Pro

This $400 Cane Has a Built-In Phone
p1022441-mp4-15-35-32-23-still001

This $400 Cane Has a Built-In Phone

Latest How To All how to videos

Windows 11 Tips and Hidden Features
240311-site-windows-11-hidden-tips-and-tricks-v2

Windows 11 Tips and Hidden Features

Vision Pro App Walkthrough -- VisionOS 1.0.3
VisionOS 1.0.3

Vision Pro App Walkthrough -- VisionOS 1.0.3

Tips and Tricks for the Galaxy S24 Ultra
240216-site-galaxy-s24-ultra-tips-and-hidden-features-2

Tips and Tricks for the Galaxy S24 Ultra

TikTok Is Now on the Apple Vision Pro
tiktok-on-vision-pro-clean

TikTok Is Now on the Apple Vision Pro

Get Your TV Ready for the Big Game: Super Bowl Setup Tips
superbowl-tv-settings-thumb1

Get Your TV Ready for the Big Game: Super Bowl Setup Tips

How to Use a Quest 3 Like the Vision Pro
240202-site-spatial-computing-on-meta-quest-3

How to Use a Quest 3 Like the Vision Pro