[APPLAUSE]
Good morning.
[APPLAUSE]
Good morning, and welcome to BUILD 2019.
It's fantastic to see you all in Seattle.
BUILD has always had a very special meaning for me.
I remember very distinctly being in the audience in 1991.
At our very first developer conference, and that's when I decided to join Microsoft, and ever since I've marked the passage of time and life in tech paradigms.
And so it's great to be back here at Build and talking about technology.
Now one service I wanted to showcase today is the Azure speech service.
Now normally the speech started getting better and better when it comes to speech recognition.
In fact what you'll see in this demo is even for commodity hardware to replace any complex [UNKNOWN] set up so that your speech recognition is world class.
So imagine a transcript that gets created That has the ability to understand the local jargon that's specific to your organization, your industry, that way making the transcript that much more useful.
So let's throw it to our team out on the gallery to show you speech translation and transcription.
Today, my colleagues and I are gonna give you a demo of new research that we believe will make meeting transcriptions more easily available to everyone in the future.
We are going to show you this demo using just the microphone built into this laptop and these two smarthphones we have in front of us.
With these we create a microphone array in the cloud that enables as we switch services to provide acurate In person meeting transcription even without a special meeting device.
Also, you'll notice that I didn't bring my phone, but the service can still recognize my voice and correctly identify me because I've given it permission to use my voice print to transcribe what I say.
Now, the second thing we're gonna show you is that the language model of Azure Speech Service can be trained on the data in your company's Microsoft 365 tenant.
So could learn the unique vocabulary of your industry or your company.
This is available in private preview.
Today, most of these assistants are command systems, where you have to invoke
These skills one at a time.
What if we can imagine a future where you can cross domains without having to invoke each skill by name?
So what is a true multi-domain assistant?
We need a multi-agent word.
The idea that you're always going to start with one wake word and one assistant, it's just not like how we start on the web, for example.
Just imagine, what does an open assistant future look like?
Similar to an open web That's what we wanna really ensure happens when it comes to the personal assistance.
[MUSIC]
What do we have today?
Here's what your day looks like.
Today you have, take a walk outside at 8 AM.
Your one on one with Anjali at 10 AM, lunch with Tom at noon.
And your app kickoff at 3:00 PM.
Go ahead and reschedule my walk to tomorrow at the same time.
Sure, I can move take a walk outside to tomorrow at 8:00 AM.
Is that right?
Yeah, that sounds great.
Okay, I've moved it to tomorrow.
And schedule a cram session with Nicholas and his manager from 9:00 until 1:30 today.
And we're gonna need a room in Bellevue.
Okay.
I'll invite Nicholas Kohn and Michelle Estes to the cram session, and I'll put your meeting in City Center 2605.
Does that look good to you?
Yeah.
And push back my one-on-one with Anjali to tomorrow.
Alright.
I've booked your meeting.
And here are a couple of options to meet with Anjali Bhat tomorrow.
Is there anything later in the day?
Let's see, how about this one?
Yeah, that'll work.
And is she invited to the app kickoff this afternoon?
No, she's not on the invite.
Well, please send it to her.
Okay, I've forwarded the app kickoff to Anjali Bhat.
Great.
[MUSIC]
Right.
After my last meeting today, schedule 30 minutes to pick up the birthday Day cake.
Sure, pick up the birthday cake at 4:00 PM.
Is that right?
Yep.
And remind me, where is my lunch meeting today?
Lunch with Tom is at Liberty Cafe.
[MUSIC]
What's the weather going to be like?
It'll be mostly sunny and 71 degrees at Libert Cafe at noon today.
Today
Can we eat outside there?
Yes.
Liberty Cafe has outdoor seating
And can you send directions to my car?
Connecting to car skill.
Sure, directions to Liberty Cafe have been sent to your car
When's our next review with Cyrus?
Your next quarterly review with Cyrus Nafani is Tuesday, June 11th at 10 AM.
Schedule a two hour dry run with Benjamin Macintosh the Friday before that.
[MUSIC]
All right.
does this work for you?
Yeah, that looks great.
I've scheduled you dry run with Benjamin.
Thank you.
Happy to help.
[MUSIC]
I'm excited to show you, our fellow developers how we at Saptial been able to enrich our existing, holographic collaboration app with HoloLens 2, Azure Spatial Anchors, the Microsoft Graph and Teams.
We're gonna show you how our customer Matel, IDH, designs and collaborates across global borders I'm not a brand that we all know and love like hot wheels Barbie in Fisher price let's take a look.
So I'm a jump on my PC here I'm already in a team's channel.
I can see Amanda's posted some cool new content but what we upgrade this to a live spatial meeting to get everyone on the same page I'm actually just going to click over to the spatial tab in teams.
And I get this really cool 3D dollhouse view.
I'm gonna click into the room where I can see everybody, but since I have a [UNKNOWN] why don't I take this off a 2D screen into a 3D meeting.
All I have to do is scan the QR code in the corner.
I'm gonna put on the device and scan the code.
Here we go
[BLANK_AUDIO]
Oops.
Hey.
Amanda, what's up?
It looks like you're already in here.
Yep.
I'm here in my office, also wearing a HoloLens 2. So you'll see me in the room show up as an avatar.
And all of our content that you just saw from that Teams channel is already up here on the wall.
You can even see some of the comments, thanks to the Microsoft Graph API.
Cool.
And with the new finger, hand tracking and holograms too, it's so easy to quickly triage content.
So I can quickly just grab a document off the wall and toss it right up there on our shared workspace so we can all take a look.
And if I want a man to check out something
I can just pull it off the wall.
And toss it to her.
What you think of that one Amanda?
Wow, that looks great.
And just to recap what happened here.
I grabbed a holographic image on the wall as a real person in this room and threw it to an avatar who could be anywhere in the world.
Wow, this is awesome.
Now, with the new hand tracking capabilities in the mixed reality toolkit, I can also have this cool new hand doc.
So let's pull it up.
And it lets me pull up content from a variety of locations, like my OneDrive.
I'm just gonna scroll the 3D models that are stored on it and select Sky Justice.
There we go.
And let's make this life size and zoom this up a little bigger.
And you know, Amand, I'm thinking why don't we show off the new free hand annotation capabilities and give her some accessories?
Absolutely, I think she really could use a bracelet, and of course, the finishing touch, a holilets.
Everyone needs a holilets.
Awesome.
Hey Lynn.
It looks like Lynn's just showing.
Hey, everyone I love this.
Joining from my PC, I'm still able to participate in the experience even without a holo-lens.
So are you ready to see what I've been working on?
Yeah, let's check it out.
Since I've joined from my laptop via the Spatial Tab and Teams you saw earlier, I can easily browse and upload content directly from my PC and upload it to the meeting.
Checkout this 3D model of hover pack>> Wait this is cool, you know Amanda since this is mixed reality, why don't you jump in and give it a spin?>> Of course let's try it out,
[BLANK_AUDIO]
Wow, it's even cooler on the inside.
Now [LAUGH].
Space is a hardware [UNKNOWN] platform, you don't need just a headset to join the experience.
So let me invite Jacob onto the stage, now he's gonna show you how you can join from the device in your pocket
[BLANK_AUDIO]
This is so dope.
I love it.
Great work, Lin.
with agile special anchors, this mixed reality experience shares a map across HoloLens, and ARKit and ARCore.
This means, that I can get out the most immersive experience on a HoloLens, or I can use this Android phone here to not only see what everyone else is seeing.
But actively participate and modify the content as well.
Nice, thanks, guys, solid meeting, and we're really looking forward to showing this to the rest of the team tomorrow.
