Highlights from Microsoft's Build 2019 conference

Virtual Reality Apps
[APPLAUSE] Good morning. [APPLAUSE] Good morning, and welcome to BUILD 2019. It's fantastic to see you all in Seattle. BUILD has always had a very special meaning for me. I remember very distinctly being in the audience in 1991. At our very first developer conference, and that's when I decided to join Microsoft, and ever since I've marked the passage of time and life in tech paradigms. And so it's great to be back here at Build and talking about technology. Now one service I wanted to showcase today is the Azure speech service. Now normally the speech started getting better and better when it comes to speech recognition. In fact what you'll see in this demo is even for commodity hardware to replace any complex [UNKNOWN] set up so that your speech recognition is world class. So imagine a transcript that gets created That has the ability to understand the local jargon that's specific to your organization, your industry, that way making the transcript that much more useful. So let's throw it to our team out on the gallery to show you speech translation and transcription. Today, my colleagues and I are gonna give you a demo of new research that we believe will make meeting transcriptions more easily available to everyone in the future. We are going to show you this demo using just the microphone built into this laptop and these two smarthphones we have in front of us. With these we create a microphone array in the cloud that enables as we switch services to provide acurate In person meeting transcription even without a special meeting device. Also, you'll notice that I didn't bring my phone, but the service can still recognize my voice and correctly identify me because I've given it permission to use my voice print to transcribe what I say. Now, the second thing we're gonna show you is that the language model of Azure Speech Service can be trained on the data in your company's Microsoft 365 tenant. So could learn the unique vocabulary of your industry or your company. This is available in private preview. Today, most of these assistants are command systems, where you have to invoke These skills one at a time. What if we can imagine a future where you can cross domains without having to invoke each skill by name? So what is a true multi-domain assistant? We need a multi-agent word. The idea that you're always going to start with one wake word and one assistant, it's just not like how we start on the web, for example. Just imagine, what does an open assistant future look like? Similar to an open web That's what we wanna really ensure happens when it comes to the personal assistance. [MUSIC] What do we have today? Here's what your day looks like. Today you have, take a walk outside at 8 AM. Your one on one with Anjali at 10 AM, lunch with Tom at noon. And your app kickoff at 3:00 PM. Go ahead and reschedule my walk to tomorrow at the same time. Sure, I can move take a walk outside to tomorrow at 8:00 AM. Is that right? Yeah, that sounds great. Okay, I've moved it to tomorrow. And schedule a cram session with Nicholas and his manager from 9:00 until 1:30 today. And we're gonna need a room in Bellevue. Okay. I'll invite Nicholas Kohn and Michelle Estes to the cram session, and I'll put your meeting in City Center 2605. Does that look good to you? Yeah. And push back my one-on-one with Anjali to tomorrow. Alright. I've booked your meeting. And here are a couple of options to meet with Anjali Bhat tomorrow. Is there anything later in the day? Let's see, how about this one? Yeah, that'll work. And is she invited to the app kickoff this afternoon? No, she's not on the invite. Well, please send it to her. Okay, I've forwarded the app kickoff to Anjali Bhat. Great. [MUSIC] Right. After my last meeting today, schedule 30 minutes to pick up the birthday Day cake. Sure, pick up the birthday cake at 4:00 PM. Is that right? Yep. And remind me, where is my lunch meeting today? Lunch with Tom is at Liberty Cafe. [MUSIC] What's the weather going to be like? It'll be mostly sunny and 71 degrees at Libert Cafe at noon today. Today Can we eat outside there? Yes. Liberty Cafe has outdoor seating And can you send directions to my car? Connecting to car skill. Sure, directions to Liberty Cafe have been sent to your car When's our next review with Cyrus? Your next quarterly review with Cyrus Nafani is Tuesday, June 11th at 10 AM. Schedule a two hour dry run with Benjamin Macintosh the Friday before that. [MUSIC] All right. does this work for you? Yeah, that looks great. I've scheduled you dry run with Benjamin. Thank you. Happy to help. [MUSIC] I'm excited to show you, our fellow developers how we at Saptial been able to enrich our existing, holographic collaboration app with HoloLens 2, Azure Spatial Anchors, the Microsoft Graph and Teams. We're gonna show you how our customer Matel, IDH, designs and collaborates across global borders I'm not a brand that we all know and love like hot wheels Barbie in Fisher price let's take a look. So I'm a jump on my PC here I'm already in a team's channel. I can see Amanda's posted some cool new content but what we upgrade this to a live spatial meeting to get everyone on the same page I'm actually just going to click over to the spatial tab in teams. And I get this really cool 3D dollhouse view. I'm gonna click into the room where I can see everybody, but since I have a [UNKNOWN] why don't I take this off a 2D screen into a 3D meeting. All I have to do is scan the QR code in the corner. I'm gonna put on the device and scan the code. Here we go [BLANK_AUDIO] Oops. Hey. Amanda, what's up? It looks like you're already in here. Yep. I'm here in my office, also wearing a HoloLens 2. So you'll see me in the room show up as an avatar. And all of our content that you just saw from that Teams channel is already up here on the wall. You can even see some of the comments, thanks to the Microsoft Graph API. Cool. And with the new finger, hand tracking and holograms too, it's so easy to quickly triage content. So I can quickly just grab a document off the wall and toss it right up there on our shared workspace so we can all take a look. And if I want a man to check out something I can just pull it off the wall. And toss it to her. What you think of that one Amanda? Wow, that looks great. And just to recap what happened here. I grabbed a holographic image on the wall as a real person in this room and threw it to an avatar who could be anywhere in the world. Wow, this is awesome. Now, with the new hand tracking capabilities in the mixed reality toolkit, I can also have this cool new hand doc. So let's pull it up. And it lets me pull up content from a variety of locations, like my OneDrive. I'm just gonna scroll the 3D models that are stored on it and select Sky Justice. There we go. And let's make this life size and zoom this up a little bigger. And you know, Amand, I'm thinking why don't we show off the new free hand annotation capabilities and give her some accessories? Absolutely, I think she really could use a bracelet, and of course, the finishing touch, a holilets. Everyone needs a holilets. Awesome. Hey Lynn. It looks like Lynn's just showing. Hey, everyone I love this. Joining from my PC, I'm still able to participate in the experience even without a holo-lens. So are you ready to see what I've been working on? Yeah, let's check it out. Since I've joined from my laptop via the Spatial Tab and Teams you saw earlier, I can easily browse and upload content directly from my PC and upload it to the meeting. Checkout this 3D model of hover pack>> Wait this is cool, you know Amanda since this is mixed reality, why don't you jump in and give it a spin?>> Of course let's try it out, [BLANK_AUDIO] Wow, it's even cooler on the inside. Now [LAUGH]. Space is a hardware [UNKNOWN] platform, you don't need just a headset to join the experience. So let me invite Jacob onto the stage, now he's gonna show you how you can join from the device in your pocket [BLANK_AUDIO] This is so dope. I love it. Great work, Lin. with agile special anchors, this mixed reality experience shares a map across HoloLens, and ARKit and ARCore. This means, that I can get out the most immersive experience on a HoloLens, or I can use this Android phone here to not only see what everyone else is seeing. But actively participate and modify the content as well. Nice, thanks, guys, solid meeting, and we're really looking forward to showing this to the rest of the team tomorrow.

Up Next

The Great Apple AI Divide Is Coming
240613-yt-omt-apple-ai-divide-wwdc-v07

Up Next

The Great Apple AI Divide Is Coming

All the Big News from Elon Musk at Tesla's 2024 Annual Shareholder Meeting
elon-1

All the Big News from Elon Musk at Tesla's 2024 Annual Shareholder Meeting

The Big News to Watch for at WWDC
omt-wwdc24-clean

The Big News to Watch for at WWDC

Watch SpaceX's 4th Starship Launch Test
amd-06-june-2024-06-19-13-am-00-00-20-01-still001

Watch SpaceX's 4th Starship Launch Test

EV One-Pedal Driving Explained in the Kia EV9
240604-site-kia-ev-9-one-pedal-drive-explained-2

EV One-Pedal Driving Explained in the Kia EV9

Everything Announced at Intel's Lunar Lake AI Chip Event
240604-site-intel-lunar-lake-chip

Everything Announced at Intel's Lunar Lake AI Chip Event

Watch Everything Announced from AMD Keynote at Computex 2024
amd-02-june-2024-06-45-10-pm-00-00-00-21-still001

Watch Everything Announced from AMD Keynote at Computex 2024

Everything Announced at Microsoft Build 2024
240521-site-microsoft-build-supercut-thumbnail

Everything Announced at Microsoft Build 2024

Everything Announced at Microsoft's Surface Copilot Plus PC Event
microsoft-event-5-20-24-20-may-2024-02-00-39-pm-00-08-21-09-still001

Everything Announced at Microsoft's Surface Copilot Plus PC Event

If Apple Makes Siri Like ChatGPT or Gemini, I'm Done
240516-site-hey-siri-lets-talk

If Apple Makes Siri Like ChatGPT or Gemini, I'm Done

Tech Shows

The Apple Core
apple-core.png

The Apple Core

Alphabet City
alphabet-city.png

Alphabet City

CNET Top 5
top-5.png

CNET Top 5

The Daily Charge
the-daily-charge.png

The Daily Charge

What the Future
what-the-future.png

What the Future

Tech Today
tech-today.png

Tech Today

Cooley On Cars
on-cars.png

Cooley On Cars

Carfection
carfection.png

Carfection

Latest News

Dreamfoam Essential Mattress Review: The Ultimate Mattress for RVs and Trailers?
The Dreamfoam Essential mattress against a colorful background with a man's hands pushing down on the side of the bed.

Dreamfoam Essential Mattress Review: The Ultimate Mattress for RVs and Trailers?

Saatva Latex Hybrid Mattress Review: Should You Buy It?
The Saatva Latex Hybrid mattress sits on a bed frame while a man tests the edge of the mattress against a colorful background.

Saatva Latex Hybrid Mattress Review: Should You Buy It?

Lull Original Premium Mattress Review: A Cut Above Lull's Original Bed
The Lull Original Premium mattress with a man laying on top of the bed against a colorful background.

Lull Original Premium Mattress Review: A Cut Above Lull's Original Bed

Nolah Signature Mattress Review: Best Bed for Side Sleepers?
The Casper Wave mattress with a man laying on top of the bed against a colorful background.

Nolah Signature Mattress Review: Best Bed for Side Sleepers?

Our Mattress Experts Unbox Bear's Brand With Scott Paladini
Three people in a room filled with mattresses against a colorful background

Our Mattress Experts Unbox Bear's Brand With Scott Paladini

Tempur-Pedic Adapt Mattress Review: Reasons to Buy or Not Buy
The Tempur-Pedic Adapt mattress against a colorful background with a man's hands pushing down on the side of the bed.

Tempur-Pedic Adapt Mattress Review: Reasons to Buy or Not Buy

Casper Snow Mattress Review: Reasons to Buy or Not Buy
The Casper Snow mattress with a man laying on top of the bed against a colorful background with a man smiling in the front.

Casper Snow Mattress Review: Reasons to Buy or Not Buy

Casper Dream Hybrid Mattress Review: Reasons to Buy or Not Buy
The Casper Dream mattress with a man laying on top of the bed against a colorful background with a man smiling in the front.

Casper Dream Hybrid Mattress Review: Reasons to Buy or Not Buy

Viture Pro XR Review: A Great Upgrade to One of My Favorite Display Glasses
240610-yt-viture-glasses-v05

Viture Pro XR Review: A Great Upgrade to One of My Favorite Display Glasses

Helix Plus Mattress Receives the Helix Treatment: Helix Plus Mattress Review
The Helix Plus mattress placed on a wooden bed frame bed frame in front of a colorful background.

Helix Plus Mattress Receives the Helix Treatment: Helix Plus Mattress Review