Using HoloLens, Microsoft overlays physical robot with holographic robot
Using HoloLens, Microsoft overlays physical robot with holographic robot
3:53

Using HoloLens, Microsoft overlays physical robot with holographic robot

Tech Industry
[MUSIC] So let's take a look, at how portability of experiences enabled in Windows 10, can change the way makers like you, interact with the physical things that you build. And to show us mixing holograms, with IOT Please help me welcome on stage my very good friend, Nico. [NOISE] Hey Alex Hi Nico. I'd like you to meet B15. This year, millions of people will use maker kits like this one to enter robot competitions and learn about electronics Many of them will use Raspberry Pi 2, which now supports Windows 10 IoT Core. We were inspired to see what we could do with the same hardware and hololens. So let me show you. B-15, wake up. [NOISE] So hello to the real B-15. Because every Windows 10 device has APIs for human and environment understanding we were able to overlay a holographic robot on top of a physical one. And one thing we noticed while working is you need your data to be easily accessible. But adding displays to this frame increases your cost and there's no way to see all that information at once. So let me show you how we check on our data. B15 control panel. This facial UI system is a universal windows app. I'm pulling the data from B15 making it as big as I need it to be. And placing it where it's relevant in my world. And I love it that Miko didn't have to actually go back to her desk to do it. This is a great example of how Windows 10 makes your digital life more powerful by connecting it with your real life. That's right, you can waste a lot of time tweaking variables on another device before you test But if all I need to do is something simple like change an LED color, I can use a control scheme, like this. So that's how we envision controls and displays evolving with holograms. Now, assuming me and Josh are robots. You can find paths safely through their workspaces. Let's take a look at how Miko can help B15 navigate and how holograms can help. So B15's sensors aren't great at detecting obstacles. But the cool thing is they don't have to be. My hollow lens can communicate that information. B15 path-finding mode. Now with Windows holographics we can scan an environment. We can que up movement tasks and visualize the robot's path. So all I have to do is air tap the ground. My hollow lens interprets the 3D points. And tells B15 when to turn and when to move forward. Now this is a great example of how portable our Windows experiences can be. This is [UNKNOWN] didn't have to know its environment, the room understanding comes from Windows holographic. But, what happens when the environment actually changes? That's no problem. Because I'm wearing hololens, I'm always aware of this as seen I can see it updated it's route to go around you, and this is critical if you're working with bigger robots, like those in automotive manufacturing. You need to always be aware of a robots intentions. Hollow Lens helps developers understand robots better at any scale or in any scenario. This is just amazing. Thank you so much Miko, and nice to meet you B15. E-13, say goodbye. See you later, Alex. Later, guys.

Up Next

What is the Fediverse?
240418-fediverse-winged

Up Next

What is the Fediverse?

The Missing Piece to Apple's Eco-Friendly Mission
240418-site-omt-the-core-problem-of-apples-green-goals-v1.jpg

The Missing Piece to Apple's Eco-Friendly Mission

Boston Dynamics Retires Its HD Atlas Robot
p1022506-00-00-01-20-still001

Boston Dynamics Retires Its HD Atlas Robot

Apple and Disney's Unique Bond: Why Vision Pro Needs the Mouse
240411-site-can-disney-save-the-apple-vision-pro-v1

Apple and Disney's Unique Bond: Why Vision Pro Needs the Mouse

The Ocean Cleanup's System 03 Collects Plastic Pollution at Record Levels
The Ocean Cleanup System 03

The Ocean Cleanup's System 03 Collects Plastic Pollution at Record Levels

Latest iOS 18 Rumor Roundup: New Designs, AI Tricks
240404-yt-omt-ios-18-siri-ai-v06

Latest iOS 18 Rumor Roundup: New Designs, AI Tricks

Apple to Talk AI in June: This WWDC Is a Big Deal
240328-yt-omt-wwdc24-v07

Apple to Talk AI in June: This WWDC Is a Big Deal

What Google Gemini AI on the iPhone Could Look Like
240321-site-apple-and-gemini-ai

What Google Gemini AI on the iPhone Could Look Like

Microsoft Surface Pro 10, Surface Laptop 6 Are Here
240320-site-microsoft-surface-pros-first-look-v2

Microsoft Surface Pro 10, Surface Laptop 6 Are Here

Everything Just Announced at Google's AI Health Event
sc-googlehealthai-00-02-29-25-still001

Everything Just Announced at Google's AI Health Event

Tech Shows

The Apple Core
apple-core-w

The Apple Core

Alphabet City
alphabet-city-w

Alphabet City

CNET Top 5
cnet-top-5-w

CNET Top 5

The Daily Charge
dc-site-1color-logo.png

The Daily Charge

What the Future
what-the-future-w

What the Future

Tech Today
tech-today-w

Tech Today

Latest News All latest news

How Google Tests the Cameras in Its Pixel Phones
240417-site-google-pixel-lab-exclusive-1

How Google Tests the Cameras in Its Pixel Phones

Boston Dynamics' New Electric Atlas vs. Tesla's Optimus
240419-wtf-atlas-vs-optimus-v04

Boston Dynamics' New Electric Atlas vs. Tesla's Optimus

What is the Fediverse?
240418-fediverse-winged

What is the Fediverse?

The Missing Piece to Apple's Eco-Friendly Mission
240418-site-omt-the-core-problem-of-apples-green-goals-v1.jpg

The Missing Piece to Apple's Eco-Friendly Mission

First Drive in the All-Electric 2024 Fiat 500e
240417-site-fiat-500e-ev-drive-program-thumbnail-v3

First Drive in the All-Electric 2024 Fiat 500e

Laptop Buying Guide: What to Look For
laptop-buying-guide-2024-00-02-36-12-still001

Laptop Buying Guide: What to Look For

Most Popular All most popular

First Look at TSA's Self-Screening Tech (in VR!)
innovation

First Look at TSA's Self-Screening Tech (in VR!)

Samsung Galaxy S24 Ultra Review: More AI at a Higher Cost
240123-site-samsung-galaxy-s24-ultra-review-4

Samsung Galaxy S24 Ultra Review: More AI at a Higher Cost

'Circle to Search' Lets Users Google From Any Screen
circlesearchpic

'Circle to Search' Lets Users Google From Any Screen

Asus Put Two 14-inch OLEDs in a Laptop, Unleashes First OLED ROG Gaming Laptop
asus-preces-00-00-25-11-still003

Asus Put Two 14-inch OLEDs in a Laptop, Unleashes First OLED ROG Gaming Laptop

Samsung Galaxy Ring: First Impressions
samsung-galaxy-ring-clean

Samsung Galaxy Ring: First Impressions

Best of Show: The Coolest Gadgets of CES 2024
240111-site-best-of-ces-2024-1

Best of Show: The Coolest Gadgets of CES 2024

Latest Products All latest products

2025 Audi Q6, SQ6 E-Tron: Audi's Newest EV Is Its Most Compelling
cnet-audiq6

2025 Audi Q6, SQ6 E-Tron: Audi's Newest EV Is Its Most Compelling

Hands-On with Ford's Free Tesla Charging Adapter
pic3

Hands-On with Ford's Free Tesla Charging Adapter

Nuro R3 is an Adorable Self-Driving Snack Bar
240320-site-nuro-r3-first-look-v1

Nuro R3 is an Adorable Self-Driving Snack Bar

First Look: The $349 Nothing Phone 2A Aims to Brighten Your Day
240304-site-nothing-phone-2-first-look-v3

First Look: The $349 Nothing Phone 2A Aims to Brighten Your Day

Best of MWC 2024: Bendable Screens, AI Wearables and More
240229-site-best-of-show-at-mwc

Best of MWC 2024: Bendable Screens, AI Wearables and More

This Concept Laptop from Lenovo Has a Transparent Display
240225-site-lenovo-translucent-laptop-concept-v3

This Concept Laptop from Lenovo Has a Transparent Display

Latest How To All how to videos

Tips and Tricks for the AirPods Pro 2
airpods-pro-2

Tips and Tricks for the AirPods Pro 2

How to Watch the Solar Eclipse Safely From Your Phone
screenshot-2024-04-03-at-15-47-11.png

How to Watch the Solar Eclipse Safely From Your Phone

Windows 11 Tips and Hidden Features
240311-site-windows-11-hidden-tips-and-tricks-v2

Windows 11 Tips and Hidden Features

Vision Pro App Walkthrough -- VisionOS 1.0.3
VisionOS 1.0.3

Vision Pro App Walkthrough -- VisionOS 1.0.3

Tips and Tricks for the Galaxy S24 Ultra
240216-site-galaxy-s24-ultra-tips-and-hidden-features-2

Tips and Tricks for the Galaxy S24 Ultra

TikTok Is Now on the Apple Vision Pro
tiktok-on-vision-pro-clean

TikTok Is Now on the Apple Vision Pro