What happens inside Tribeca's hit VR experience 'Jack'?
What happens inside Tribeca's hit VR experience 'Jack'?
6:32

What happens inside Tribeca's hit VR experience 'Jack'?

Tech Industry
[MUSIC] I'm Joan E. Solsman. And I'm Scott Stein. We spent a lot of time at the Tribeca Film Festival in the last week and a half. And it's kind of a rarified experience, getting to go through some of these V.R. installations, so we though we'd walk you through our experience, and one in particular. Yeah, Jack, which was. The wildest one that we did is basically Blaine's VR and immersive theater. So it is kind of like using a VR headset at home but the cool thing about what you get to do at a lot of these festivals and spaces is it is a lot more like an art installation so you are free to move in this larger space and you wear the headset and you interact with actual actors. I got suited into this VR backpack, and I put on the headset, and I didn't know what was gonna come next. There is also an entertainment complex called The Void that does this with Star Wars and things like that. The difference here is again life actors. So I was put through a door, and the all of the sudden I'm in this cartoon House. And as I'm walking around I don't have controllers, which is the other cool part. It's using leap motion which is using sensing to track my hands without any control. So I see a light as I walk past the dangling light it actually hits me in the hand. So these are real objects. I can reach out and grab the light. I go to the tea pot. There's a real tea pot. And my frog mom is with a broom. She pushes the broom, hits me in the foot with the real broom, tells me to go sell a radio. And I don't know if I'm gonna do that. I start to talk and realize I can say whatever I want and they're acting back with me and suddenly I'm in a play. And then I had, when she left, and I had to go figure out what to do. And all of a sudden this Airship arrives on a balcony and I go, should I go walk out there? Sure, and I'm able to walk anywhere. And I step out onto the balcony with wind and this bird creature-trader. Steampunk bird merchant. Yeah, steampunk bird merchant wants something to buy and I don't know what. So I try to Fake her out by grabbing something else like a tea pot she's no that's not interesting so finally I take the radio and she grabs it from from me and I'm like pulling with a real radio over the balcony and she takes it and I lose the negotiation and I get handed a giant magic bean and mom comes back and gets really upset and I'm just like. Becoming Jack at this point. It was the best bean that they had. The best bean that they had? Jack! And then a beanstalk rises but at this point, I thought wow, I'm walking around. I'm sitting on the bed, I'm doing these things, I know I'm in a thing that almost feels like a video game. But the fact that I can say whatever I want Starts to put me in the role. And you enter it too. Yeah. I think we actually had a slightly different experience. Interesting. Naturally, by the nature of their being, live actors and you're responding to them and them responding to you, everybody is experience is gonna be a little bit different. Mm-hm. The story definitely follows a very, there are definitely points that all follow the same arc like I also My frog mom was also sweeping a broom but when I first interacted with her it was me taking initiative touching her before she reached me so I reached out to touch her and kind of surprised myself when I reached out to touch her and I didn't just bat away air. It was an actual human like flesh and blood thing. [LAUGH] Who got annoyed with me for bothering her while she was trying to clean. So it's neat that you can kind of, you start to develop a relationship with a trained actor who knows how to create a relationship with an audience member that they're supposed to be interacting with. It was like, am I just doing like comedy improv now with the trader and it reminded me of those mpcc's in video games where like You know at what point like do I not have a choice and what would happen if I wasn't in the mood? Would they find a way to still guide me almost like a theme park. Now talk about your experience at the end at the conclusion of that chapter of the story because I think we had a different expirence with that too. You did? Yeah. Ok so I remember at the very end That I, the frog mom goes away, this is where it gets a little fuzzy. Frog mom goes away, I go what do I, and she's really upset, like you know, what did you do Jack? It's [CROSSTALK] After you traded her beloved radio for a crappy magical bean. She throws my bean out the window as you'd expect like a very, I don't know what, I just say mom, come on I'm playing along, and as she leaves there's a rumbling. And all of the sudden, everything begins to get kind of crazy, and actually everything is moving. And then I didn't know what was going on. I kind of whited out. And then I turned around and I saw that there was a bean stalk sprouting. And that's when I said. I figured it they we are being stuck. And then I know what happened. And then I think it kind of fades out, and it is to be continued. And I think at that point I remember what happened, I think they took my headset off obviously, but I was- Where you in the room still? I was not in the room. I got lead out. They lead you back out on to the balcony, so I saw nothing that was in the room, but I know that we recorded what was in the room. But I peeked at it later and it looks nothing like what I thought it would. [LAUGH] But no, I didn't get to see anything in there. So I think what happened is you actually had a computer malfunction in the middle of [LAUGH]- Are you serious? [LAUGH] Of your experience, yeah. Because I, at the end of mine, She throws the bean out the window, the ground begins to shake, and the room begins to shake visually. And you feel the sensation of the whole house being lifted up on the beanstalk. Mm-hm. And at the end of mine instead of it whiting it out it kind of You can look around, and you can see things, and you're lifted up very high in the air. You can look down the beanstalk, and it kind of transitions to showing you the door in virtual reality that you came in through. And it says above the door to be continued, so it prompts you to lead yourself through the door. That's actually through the door to the room so that you can transition to the next part of the story which hasn't been made yet but. That makes a lot more sense. But I think that's a testament to how these things work that it didnt' go as planned with yours but you Story wise you couldn't really tell. But it was fine. And you could tell, that's the problem, is things logistically are so many things going on. That, where do you install this? I guess, they're trying to find places to do this, but it's not easy production. So that's our Vera Theatre experience. Part one. [MUSIC]

Up Next

Scuba Diving With the Apple Watch Ultra
scuba-thumb-3

Up Next

Scuba Diving With the Apple Watch Ultra

Why I Switched to iPhone
abrar-1

Why I Switched to iPhone

Real Estate Pro Breaks Down Property for Sale in the Metaverse
experts-react-11

Real Estate Pro Breaks Down Property for Sale in the Metaverse

What These Wild Animal Robots Are Teaching Engineers (Biophysicist Reacts)
animal-robots-3

What These Wild Animal Robots Are Teaching Engineers (Biophysicist Reacts)

Inside Meta's Reality Labs: Hands-On With the Future of Metaverse
scott-w-head-tracker

Inside Meta's Reality Labs: Hands-On With the Future of Metaverse

Pixel Watch Is Just the Start for Fitbit on Wear OS, Says Google's Wearables Chief
google-interview-park2

Pixel Watch Is Just the Start for Fitbit on Wear OS, Says Google's Wearables Chief

We Put a GoPro Against the iPhone 14's Action Mode
iphone14-can-it-replace-gopro-clean

We Put a GoPro Against the iPhone 14's Action Mode

Tesla AI Day 2022: The Biggest Announcements
supercutcnet

Tesla AI Day 2022: The Biggest Announcements

What It's Like Playing VR Football: NFL Pro Era Hands-On
nfl-cut-5-with-vo-00-00-34-02-still009

What It's Like Playing VR Football: NFL Pro Era Hands-On

Tech Shows

The Apple Core
apple-core-w

The Apple Core

Alphabet City
alphabet-city-w

Alphabet City

CNET Top 5
cnet-top-5-w

CNET Top 5

The Daily Charge
dc-site-1color-logo.png

The Daily Charge

What the Future
what-the-future-w

What the Future

Tech Today
tech-today-w

Tech Today

Latest News All latest news

Rad Power Bikes Addresses Gap in Micro-Mobility With the RadTrike
radtrike-00-01-12-05-still001

Rad Power Bikes Addresses Gap in Micro-Mobility With the RadTrike

Best Streaming Devices of 2022
best-streamers-2022-thumb

Best Streaming Devices of 2022

Forget the Kids. These Toys Make Great Adult Gifts
bridgetnerf

Forget the Kids. These Toys Make Great Adult Gifts

See Why the Semi May Be Tesla's Most Important Vehicle
tesla-semi-00-02-40-12-still001

See Why the Semi May Be Tesla's Most Important Vehicle

How to Create Holiday Greeting Cards Using Keynote
ipadgreetingcard-site-thumb

How to Create Holiday Greeting Cards Using Keynote

Watch Elon Musk's Semi Event in 9 Minutes
tesla-sb-v1-00-00-02-01-still001.png

Watch Elon Musk's Semi Event in 9 Minutes

Most Popular All most popular

Forget the Kids. These Toys Make Great Adult Gifts
bridgetnerf

Forget the Kids. These Toys Make Great Adult Gifts

Elon Musk Shows Latest Neuralink Demo of Monkey Typing with its Mind
neuralmonkey

Elon Musk Shows Latest Neuralink Demo of Monkey Typing with its Mind

Watch Elon Musk's Semi Event in 9 Minutes
tesla-sb-v1-00-00-02-01-still001.png

Watch Elon Musk's Semi Event in 9 Minutes

EVs vs. Gas Engines: We Do the Math on Carbon Emissions
evs-exposed-still

EVs vs. Gas Engines: We Do the Math on Carbon Emissions

2022 Ford Bronco Raptor: This Big Bronco Is Here
ford-bronco-raptor-still-v1

2022 Ford Bronco Raptor: This Big Bronco Is Here

Best Android Phones of 2022: Samsung, Google, OnePlus and More
1203459317449832-laz1jqjqlhclzhrpcncs-height640.png

Best Android Phones of 2022: Samsung, Google, OnePlus and More

Latest Products All latest products

Rad Power Bikes Addresses Gap in Micro-Mobility With the RadTrike
radtrike-00-01-12-05-still001

Rad Power Bikes Addresses Gap in Micro-Mobility With the RadTrike

See Why the Semi May Be Tesla's Most Important Vehicle
tesla-semi-00-02-40-12-still001

See Why the Semi May Be Tesla's Most Important Vehicle

First Look at Archer's Midnight Air Taxi
midnight

First Look at Archer's Midnight Air Taxi

Holoride Hands-On: VR in the Car Is Like a Disney Ride
holoride-00-00-03-12-still003

Holoride Hands-On: VR in the Car Is Like a Disney Ride

Hands-on With All of Microsoft's New Surface Devices
surfacepro9-event-00-00-04-05-still004

Hands-on With All of Microsoft's New Surface Devices

Microsoft Introduces Surface Studio 2 Plus
surfacestudio

Microsoft Introduces Surface Studio 2 Plus

Latest How To All how to videos

MacOS Ventura Continuity Camera Turns Your iPhone Into a Webcam
1203246975312353-pnmdl8bwygpxcjffhlcf-height640.png

MacOS Ventura Continuity Camera Turns Your iPhone Into a Webcam

How to Clean Your Keyboard's Sticky Keys
3keyboards

How to Clean Your Keyboard's Sticky Keys

How to Play Games from PlayStation Plus on PC
psstill

How to Play Games from PlayStation Plus on PC

How to Delete or Disable Your Instagram Account
phoneonorange

How to Delete or Disable Your Instagram Account

Fix Your iPhone Screen With Apple's Self-Service Repair Kit
dsc00641

Fix Your iPhone Screen With Apple's Self-Service Repair Kit

How to Buy a Budget Laptop in 2022
budgetlaptops-00-08-35-15-still001

How to Buy a Budget Laptop in 2022