Amazon debuts Firefly technology
Amazon debuts Firefly technology
6:02

Amazon debuts Firefly technology

Mobile
Alright. How about something a little bit different? I'm going to demo something we call Firefly for you. I think you're going to like it. I am going to go really fast because I want to show you how fast this is. I'm gonna press and hold the firefly button. And starts recognizing things, phone number, recognizes the book, recognizes the DVD, QR code, CD Recognize an oral. How about a game What's this? Kosher salt, look at the bar code Kind bars. Spot It, great family game, highly recommended. I have a Nutella lever in my house and dish washing detergent. All right, so, let's pull up the history on those. And take a look. I did that fast as you could see, how quick firefly is. There's the, you see the dish washing detergent at the top? the Nutella and the spot it and so on, and we can come down. Now we recognize the phone number, we recognize the oral. I can tap on any of these items, and there are actions. So I'll tap on the book and you can see I can buy the Kindle edition, I can buy the paperback, I can go into the audio book store, I can share it with a friend, and so on. Okay. I wanna also show you. That Firefly can not only see, but Firefly can also listen as well. [MUSIC] Sunshine by Courtyard Hound. And let's look at the actions here, you can buy the MP3, you can buy the CD, but you can also, third parties can build actions for Firefly. So here's I heart radio as one example, Well, I heart radio does have, a action, that, creates an I heart radio station. Using the song that I just recognized as the seed for the station. Let's tap on that. Let's just do it. And there it is. It's as easy as that. Okay, pause that. And Firefly can even recognize TV shows. Can you play that episode please? That's not what happened! Yes, it is. They all attacked me and she threw my sword in the river. Liar. Shut up. Enough! He tells me one thing, she tells me another. We have just recognized [NOISE] [LAUGH]. We've just recognized the King's road. It's episode two from season one of Game of Thrones. And we haven't just recognized the episode, we've recognized the scene. So we are 49 minutes and one second into that scene. And so now we have all the x-ray data available. You can see all the actors in that scene. One of the actions here you can just quickly just go to the imdb page if you want more detail. Okay. Firefly can recognize something else too. Firefly can recognize art. Let's try this. Cornflowers. Tap on the action there, will pull up the Wikipedia entry. You can learn about the artist, learn about the painting. Can you pull up the next painting, please. Man with Red Hat, pull up that. There you go. Wikipedia info, learn about the painting, learn about the artist. One more thing. If you pull up the phone number. Just, if you're walking down the street, you can do this from a distance too. You don't have to be, it doesn't have to be a poster. So there I just recognized that phone number. That's it. Super simple. These are, so the other, I mean there are just tons and tons of techniques that have to be stitched together to make this work in the real world. And all of that work on Firefly, all of that advanced computer science. Would it be completely wasted if you couldn't get to firefly quickly. So that's why we gave firefly a dedicated button. Press or hold the firefly button, no matter what you are doing, if you are in the middle of text messages, anything that you are doing on the phone. Press and hold that button even from the lock screen, even behind your pin and, baam, up comes Firefly. The fireflies get released and they immediately start recognizing. That's really critical because if you have to, you know, type in your pin or go to your app grip, find the right app, tap on something. And then get it recognizing, there's so much friction in that process, you, were just not gonna use it very often. Firefly is so easy to access customers gonna love this and super exciting for us,. Is they're also making available a software development kit, so third party developers can build on top of Firefly. [MUSIC]

Up Next

Apple Products We're Expecting in 2024
231121-site-whats-coming-in-2024-apples-leftovers-v3

Up Next

Apple Products We're Expecting in 2024

Exploring Spatial Video: What It's Like to View, Shoot 3D iPhone Videos
231116-site-what-to-know-about-spatial-video-v2

Exploring Spatial Video: What It's Like to View, Shoot 3D iPhone Videos

Apple Watch Double Tap Early Impressions
231109-site-double-tap-commentary

Apple Watch Double Tap Early Impressions

Apple's M3 Sparks a New Era of Mac vs. PC Battles
231102-site-the-return-of-mac-vs-pc

Apple's M3 Sparks a New Era of Mac vs. PC Battles

Apple Unveils 14-Inch, 16-Inch MacBook Pros With M3 Processors
pic

Apple Unveils 14-Inch, 16-Inch MacBook Pros With M3 Processors

Apple Debuts 24-Inch iMac With M3 Chips
apple-unveils-new-24-inch-imac-with-m3-processor-mp4-00-00-08-12-still001

Apple Debuts 24-Inch iMac With M3 Chips

Trick or Treat? Apple's 'Scary Fast' Mac Event Makes Us Jumpy
scary-fast-apple-event-clean

Trick or Treat? Apple's 'Scary Fast' Mac Event Makes Us Jumpy

I Upgraded to the iPhone 15 Pro Max: Was It Worth It?
thmbcnet

I Upgraded to the iPhone 15 Pro Max: Was It Worth It?

See Motorola's Bendable Wristwatch Phone Concept at Lenovo World
lenovo-image-cnet

See Motorola's Bendable Wristwatch Phone Concept at Lenovo World

Apple's New Pencil and The Awkward Charging Era
231019-yt-apple-show-apple-pencil-v02

Apple's New Pencil and The Awkward Charging Era

Tech Shows

The Apple Core
apple-core-w

The Apple Core

Alphabet City
alphabet-city-w

Alphabet City

CNET Top 5
cnet-top-5-w

CNET Top 5

The Daily Charge
dc-site-1color-logo.png

The Daily Charge

What the Future
what-the-future-w

What the Future

Tech Today
tech-today-w

Tech Today

Latest News All latest news

CNET's Best Smartphones From 2023
cnet01

CNET's Best Smartphones From 2023

These Are the Best Wireless Noise-Canceling Headphones for 2023
broll-00-00-58-10-still001.png

These Are the Best Wireless Noise-Canceling Headphones for 2023

Why I Don't Regret Ditching My Android for an iPhone
cnet

Why I Don't Regret Ditching My Android for an iPhone

Apple Products We're Expecting in 2024
231121-site-whats-coming-in-2024-apples-leftovers-v3

Apple Products We're Expecting in 2024

Steam Deck OLED vs. Lenovo Legion Go: Pick a Handheld Gaming PC
lenovo-legion-go-vs-steamdeck-oled-cnet-00-00-43-16-still005.png

Steam Deck OLED vs. Lenovo Legion Go: Pick a Handheld Gaming PC

Tips and Tricks for the Galaxy Watch 6
231120-site-tips-tricks-and-hidden-features-v2

Tips and Tricks for the Galaxy Watch 6

Most Popular All most popular

iPhone 15 Pro Max vs. Pixel 8 Pro: Comparing Camera, Battery and Display
vs-seq-00-16-43-25-still005

iPhone 15 Pro Max vs. Pixel 8 Pro: Comparing Camera, Battery and Display

The PlayStation 5 Slim: Hands-On
p1019822

The PlayStation 5 Slim: Hands-On

These Are the Best Wireless Noise-Canceling Headphones for 2023
broll-00-00-58-10-still001.png

These Are the Best Wireless Noise-Canceling Headphones for 2023

Samsung's 98-inch 8K TV Is Big, Bright and Really Expensive
samsung98in-2

Samsung's 98-inch 8K TV Is Big, Bright and Really Expensive

PlayStation Portal Review
portal-cms

PlayStation Portal Review

CNET Editor Reacts to Vision Pro Spatial Video
04-viewing-spatial-videos-in-apple-vision-pro

CNET Editor Reacts to Vision Pro Spatial Video

Latest Products All latest products

The PlayStation 5 Slim: Hands-On
p1019822

The PlayStation 5 Slim: Hands-On

CNET Editor Reacts to Vision Pro Spatial Video
04-viewing-spatial-videos-in-apple-vision-pro

CNET Editor Reacts to Vision Pro Spatial Video

Samsung's 98-inch 8K TV Is Big, Bright and Really Expensive
samsung98in-2

Samsung's 98-inch 8K TV Is Big, Bright and Really Expensive

300-Mile Honda Prologue EV Hits the Road Next Year
hondapic2

300-Mile Honda Prologue EV Hits the Road Next Year

Meta's Ray-Bans, Hands-On: These Glasses Now Stream to Instagram
raybanglassescnet

Meta's Ray-Bans, Hands-On: These Glasses Now Stream to Instagram

Vizio's New Quantum Pro TVs Could Be a Strong Value Play
new-vizio-tvs-cnet-00-00-41-11-still001.png

Vizio's New Quantum Pro TVs Could Be a Strong Value Play

Latest How To All how to videos

Tips and Tricks for the Galaxy Watch 6
231120-site-tips-tricks-and-hidden-features-v2

Tips and Tricks for the Galaxy Watch 6

How to Use ChatGPT's New Voice Conversations
how-to-use-chatgpt-voice-chat-00-03-01-13-still003

How to Use ChatGPT's New Voice Conversations

How to Add Multiple Accounts and Set Up a Parent-Supervised Account on the Quest 3
add-accounts-on-quest-3-00-02-59-11-still005

How to Add Multiple Accounts and Set Up a Parent-Supervised Account on the Quest 3

How to Take Screenshots in Windows 11
p1022383-00-00-00-06-still003

How to Take Screenshots in Windows 11

10 Must-Try Hidden iOS 17 Features on Your iPhone
230921-site-ios-17-hidden-features

10 Must-Try Hidden iOS 17 Features on Your iPhone

How to Record Your Screen in Windows 11
how-to-record-your-screen-in-windows-11-00-00-48-13-still002

How to Record Your Screen in Windows 11