Say hello to Hololens 2.
[APPLAUSE]
[MUSIC]
[MUSIC]
[MUSIC]
[MUSIC]
[MUSIC]
[MUSIC]
Now this are the smallest, the most power efficient 2K display this place in existence.
Now they allow was to dramatically [UNKNOWN] while shrinking the size of this place.
But immersion is about more than just the holograms of place in the world.
Immersion is also about how you interact with them.
HoloLens 2, adapts to you, it adapts to your hands, and goes beyond the gestures to give you the satisfaction of direct manipulation, letting you experience what it feels like for the first time To actually touch a hologram.
To top it off, HoloLens 2 now also understands precisely where you are looking, enabling us to do things like understanding your intent and adapting the holograms in real time to your eyes, then using the same cameras with enabled Windows Hello Iris base biometric authentication.
The most secure and reliable enterprise grade solution.
We optimized HoloLens to you for long wear and comfort, keeping with Microsoft's tradition of inclusive design, with 3D scans the heads of thousand of people across a wide range of ages, genders and ethnicities.
And we then use this data to create a device that once again sets the highest bar for both ergonomics, as well as comfort.
HoloLens 2 has a universal fit system that works on the broadest and most diverse range of people, whether you wear glasses or not.
Putting it on should be as simple as putting on your favorite hat.
We reduced the weight of HoloLens 2 by making the front enclosure entirely out of carbon fiber.
Making a light and durable and a device that is ready for the modern workplace.
And we also fundamentally changed how that weight is distributed, making you feel as if the device is floating on your head.
Now as a result of these and hundreds of other changes, I'm incredibly proud that with Hollow Lens 2, we more than tripled the comfort of the device.
Hollow Lens 2 sets a new standard for comfort in mixed reality headsets.
Now the list of innovations in Hollow Lens 2 goes on and on.
But instead of telling you about it, why don't we show you?
Now, as Alex mentioned, HoloLens 2 is very comfortable.
It fits just like a hat.
And the only thing that's even more effortless is I'm automatically signed in.
With Windows Hello and iris authentication, the HoloLens 2 is actually signing me in as I put on my device.
Now not only does HoloLens 2 recognize me, it also recognizes my hands.
Look at this, fully articulated hand tracking.
And as I move my hands around the HoloLens 2 is actually calibrating to my unique hands size.
And of course Not only does the HoloLens 2 recognize me and my hands, it also recognizes the world.
[SOUND]
Welcome to my mixed reality home.
This is the place where I have all the apps and content that I use every day.
Let's check some of them out.
Now, I see many people put on HoloLens for the first time, and the first thing people do when they put on the device Is that we touch their hands and try and touch the holograms, and now you can.
Look at the way the hologram's responding to my hand almost inviting me to touch it.
And in fact, I can just grab this corner and resize it.
Or I can rotate it.
Or move it.
That's right.
We are touching hologram This an app I've got called Spatial.
Let me just put it right there.
I've got another app here called Vuforia view, now it's really big, for me to see, it's two hands here to make it smaller and then rotate it, so you can see.
There we go, and then let me put it down here on your space show, maybe a little bit smaller, yah, that's nice.
Al right, now, let's switch gears and talk about a different kind of an application.
I've got a browser over there but it's kinda far away and I don't really want to walk over there so let me just call it with my voice follow me this is a browser is running Microsoft teams which is a tool that we use back to collaborate let me see what the team has been working on okay.
It looks like they got a surprise for me in the playground but I just have to say the words show surprise.
All right, so let me just open that start menu here and then place the app.
And then launch it.
[SOUND] So now we're actually exiting my mixed reality home and going into an emersed experience.
But notice that that browser that I had actually followed me in.
Now this can actually be really useful when you have things like emails or pdf's that you need to reference while you're doing your work.
[MUSIC]
I don't really want it following me around while I am showing you all this cool stuff.
So let me just put it over here and get back to it later.
Welcome to the playground.
We spent years exploring and refining interactions for Hollands 2. And the playground is just a tiny sampling of the many prototypes that we built Tested, and learned from.
Our approach is basically to try out as many things as we could, and look for the things that stood out.
So, for example here I've got three sliders.
Each of them is controlling this wind farm simulation.
But each in a different way, using a different interaction technique.
One of the things we tried is this touch slider here.
So here I could just stick my finger in the slider and have it go to a particular value to control that wind speed there.
[SOUND]
It felt okay.
We also tried this push slider.
So this guy kind of nudged from side to side, kind of like an abacus, which was interesting.
[SOUND]
Now, the interaction that really took home the cake, though, was the cinch slider.
The way that works is you just pinch it and move it wherever you want.
And what we found was that people really liked that tactile sensation their fingers touching as they grabbed and released and across the board from all interactions, the audio and visual feedback as you grab, move, and then release were all really critical for making this experience feel connected.
This is just so satisfying I can't wait for you all the try this out.
All right now it's a kind of control buttons, how do you press buttons on Hollins too well you just reach out and press them now one interesting thing that we found about buttons was that the size of the buttons actually impacted the way that people interact with.
So,for example, for the smaller one, most people would use one maybe two fingers.
But for the large one, pretty much everyone used their entire hand.
And this is kind of interesting when you think about it because, these objects don't really weight anything, they're just digital things.
But despite that, people would treat them as real things, almost as the bigger one had more weight I just love the way it is moving the sounds they play when I press them.
It's great.
All right.
How about something that uses all the ten fingers?
Well, let's test that out.
We built a piano.
So here, I can just play a chord [SOUND]
or I can play the keys one at a time.
[MUSIC]
All right, so what was that surprise that the team had for me?
That's right, I had to say those words, show surprise.
[SOUND] Look at that humming bird over there, it's gorgeous.
I wonder if it will fly to my hand.
Yeah, wow.
This is beautiful.
I just love the way that it's following my hand around, I've got to tell the team, they've done a great job.
And in fact I don't need to use my hands to do this, because I can use my eyes and my voice.
That's right.
Hololens 2 has eye tracking.
So, I could just look over this browser here and look at the bottom of the screen to scroll it and then send my message.
Start dictation.
The hummingbird looks great!
Send.
[MUSIC]
So this is what we mean by instinctual interaction.
By combining our hands, our eyes, and our voice [UNKNOWN] works in a more human way.
Today, companies tackling the world's biggest companies are increasingly spread across the world.
And the [UNKNOWN] lets us work together as if we were standing next to each other face to face.
To show you how that works, let me just flip into spatial here with my HoloLens 2 and materialize the room.
Hi, Jinha.
Hi, Anand.
Hey, everyone, it's great to be here on stage holographically.
It's great to have you here, Jinha.
Can you tell everybody a little bit about what you're seeing?
Sure.
I can see your life like avatar which we generate in seconds from a 2D photo, and we can walk around the stage with spatial audio, and use this whole space around us to collaborate as if we're all here together in the same room.
Cool, now to show you how companies are using spatial to transform the way they work, let's invite Spend Gadgets CTO of the iconic brand Toy brand [UNKNOWN] to the stage.
Hey guys, how awesome is this?
So at Mattel we're undergoing a massive digital transformation.
It's touching all aspects of our business.
This includes the way that we're using technology to design and to develop our products.
Our classic brands like Barbie and Hot Wheels and Fisher Price, they have diverse teams of designers, engineers, marketers, and manufacturers that are spread all over the world.
They can now come together in a spatial project room, reducing the need to travel as much to get everybody on the same page.
Okay guys, let's come up with some ideas for a line of aquatic toys.
Yeah.
How about sea turtles?
[BLANK_AUDIO]
That's really cool.
Let's try sharks.
That's cool, how about.
Jelly fish.
So all we have to do is say the words and they're instantly visualized right before our eyes.
You can click into one of these bundles and they expand into a full blown Internet search complete with 3D models, images, and web pages.
Joe why don't we click into just the images here so we can get some good inspiration for this [UNKNOWN]
line.
Sure.
Every object you see in Spatial, is physical and tech tile.
So you can scroll through, or pick up images you like, and toss them up on the wall with physics.
And we don't have to just stick with digital content, I can actually pull up these sketches I did on my phone last night, using that same Spatial app I just pull up those photos and hit Send.
And they're instantly transformed into this digital environment.
Nice drawings.
It's so easy to fill up your room with ideas.
So we built this tool to help you quickly organize all these ideas.
So let me select all of these.
And let's make a grid.
This goes to the wall.
Now this entire room we've created is a persistent digital object that anyone can access or contribute to at any time.
Whether they're using an AR or VR headset, or even a PC or mobile phone.
So that's right, now we can have virtually rich visual rooms that we can keep up for the life of the product.
That means no more tearing down [UNKNOWN] all the time.
[BLANK_AUDIO]
So Spatial [UNKNOWN] are helping us drive improvements in our digital design and development process, changing the way we create new toys.
By bringing people together from all over the world, to collaborate in the same virtual room
We're overcoming a natural barrier to our collective success.
That's people's desire for direct face-to-face interaction when building committment and trust.
We're so excited to see faster time to market and reduced need to travel, as well as the many other benefits that we're gonna unleash at Mattel as we collaborate in mixed reality.
[APPLAUSE]
Thank you.
Thank Alex.
Now, keeping with the theme of time value.
We have seen Hololens get use in a variety of different environments.
Environments ranging from construction sites to operating rooms.
To even the International Space Station.
I see lots of different training experiences here.
There's the blower one where you was talking about.
Let me go ahead and select it.
Now I need to place it on the stage.
Let's click center stage and place the big blower.
Wow!
It's beautiful.
So Alex is now viewing the experirence that Maria published from [INAUDIBLE] studio
Which includes live IOT data streaming in from an actual blower out in the field.
While this experience offers significant benefits from a time and cost of training perspective, thus far it's only been geared for individual participation.
But now, let's make it more collaborative.
By leveraging the Azure spatial anchor service within [UNKNOWN] Studio and [UNKNOWN], we can let Maria seamlessly join in Alex's experience.
Maria can simply take out her iPad, and launch [UNKNOWN].
Once Maria points her iPad at the same location where Alex placed the blower She can participate in the mixed reality experience making it far more interactive and collaborative.
That's right Jim.
Now that Alex and I can share the same experience, I can create a number different training scenarios.
Alex, let's simulate a gear failure mode.
I see there gear vibration went down, and I have there threshold exceeded.
Please inspect.
Let's go ahead and select that.
Alex, I think you might be dealing with dealing with a broken gear tube and you will probably have to replace the gear assembly.
All right.
I'll roll up my sleeves and get some work done here.
Let's do it.
[LAUGH] I'm ready.
Right, I'm gonna start it.
This is assembly instructions for the gear assembly.
[BLANK_AUDIO]
There it is.
I see it.
[BLANK_AUDIO]
Now that Alex is using Holands Two, he has access to a wide range of hand and eye tracking capabilities.
That are all available and for your studio and view.
All right, let's put it back.
That is so awesome.
Fantastic.
Euphoria Studio allowed Bria and Howden to create a single mixed reality experience without worrying about which platform it would be viewe on.
