Project Astra Revealed at Google I/O
Project Astra Revealed at Google I/O
3:44

Project Astra Revealed at Google I/O

Tech
Speaker 1: End up powering a new set of transformative experiences. Today we have some exciting new progress to share about the future of AI assistance that we're calling Project Astra. Speaker 1: For a long time we've wanted to build a universal AI agent that can be truly helpful in everyday life. Our work making this vision a reality goes back many years. It's why we made Gemini multimodal from the very beginning. [00:00:30] An agent like this has to understand and respond to our complex and dynamic world just like we do. It would need to take in and remember what it sees so he can understand context and take action, and it would have to be proactive, teachable, and personal so you can talk to it naturally without lag or delay. While we've made some great strides in developing AI systems that can understand multimodal information, getting response time down to something conversational is a difficult engineering challenge. [00:01:00] Building on our Gemini model, we've developed agents that can process information faster by continuously encoding video frames, combining the video and speech input into a timeline of events and caching this for efficient recall. We've also enhanced how they sound with a wider range of intonations. These agents better understand the context you're in and can respond quickly in conversation, making the pace and quality of interaction feel much more natural. Here's [00:01:30] a video of our prototype, which we'll see has two parts. Each part was captured in a single take in real time. Speaker 2: Okay, let's do some tests. Tell me when you see something that makes sound. Speaker 3: I see a speaker, which makes sound. Speaker 2: What is that part of the speaker called? Speaker 3: That is the tweeter. It produces high frequency sounds. Speaker 2: [00:02:00] Give me a creative alliteration about these Speaker 3: Creative crayons, color cheerfully. They certainly craft colorful creations. Speaker 2: What does that part of the code do? Speaker 3: This code defines encryption and decryption functions. It seems to use A-E-S-C-B-C encryption to encode [00:02:30] and decode data based on a key and an initialization vector iv. Speaker 4: That's right. Speaker 2: What neighborhood do you think I'm in? Speaker 3: This appears to be the King's cross area of London. It is known for its railway station and transportation connections. Speaker 2: Do you remember where you saw my glasses? Speaker 3: Yes, I do. Your glasses. Were on the desk near a red [00:03:00] apple. Speaker 2: What can I add here to make this system faster? Speaker 4: Adding Speaker 5: A cache between the server and database could improve speed. Speaker 2: What does this remind you of? Speaker 5: Schrodinger's [00:03:30] cat. Speaker 2: Alright. Give me a band name for this duo. Speaker 5: Golden Stripes. Speaker 2: Nice. Thanks Gemini.

Up Next

Apple Introduces Private Cloud Compute for AI Processing
ipados-00-09-14-29-still003

Up Next

Apple Introduces Private Cloud Compute for AI Processing

iPad OS Finally Gets Calculator App
ipados-00-03-27-16-still002

iPad OS Finally Gets Calculator App

Everything Announced at Microsoft's Xbox Showcase Event
xboxshowcase-supercut-cnet

Everything Announced at Microsoft's Xbox Showcase Event

Project Astra Revealed at Google I/O
screenshot-2024-05-14-at-1-42-51pm.png

Project Astra Revealed at Google I/O

See Apple's New 'Squeezable' Pencil Pro
pencilproclip-00-01-31-15-still001

See Apple's New 'Squeezable' Pencil Pro

Amazon Debuts All-New Echo Show 8
amazonechoshow8-00-00-17-27-still001

Amazon Debuts All-New Echo Show 8

Watch Everything Sony Announced at CES 2023
230104-clean-sony-ces-supercut

Watch Everything Sony Announced at CES 2023

Watch Everything Announced at LG's CES Event
thumb

Watch Everything Announced at LG's CES Event

Watch Everything Nvidia Announced at Its CES RTX Event
nvidia-supercut-1

Watch Everything Nvidia Announced at Its CES RTX Event

Elon Musk unveils new Starship mission video
starship-thumb

Elon Musk unveils new Starship mission video

Tech Shows

The Apple Core
apple-core.png

The Apple Core

Alphabet City
alphabet-city.png

Alphabet City

CNET Top 5
top-5.png

CNET Top 5

The Daily Charge
the-daily-charge.png

The Daily Charge

What the Future
what-the-future.png

What the Future

Tech Today
tech-today.png

Tech Today

Cooley On Cars
on-cars.png

Cooley On Cars

Carfection
carfection.png

Carfection

Latest News

Our Fave EV Truck Gets Even Better: Testing the New Rivian R1T, R1S
240610-yt-rivian-off-road-experience-v04

Our Fave EV Truck Gets Even Better: Testing the New Rivian R1T, R1S

Home Security Cams Like My Nest Doorbell Are Getting Smarter With AI
must-use-subject-ring-doorbell-device

Home Security Cams Like My Nest Doorbell Are Getting Smarter With AI

Apple Watch: New Features Coming in WatchOS 11
cnet

Apple Watch: New Features Coming in WatchOS 11

Apple's MacOS Sequoia: The New Features You'll Want to Try
240610-yt-macos-ai-mac-vs-ai-pc-v06

Apple's MacOS Sequoia: The New Features You'll Want to Try

Apple Intelligence: What to Know About Apple's Gen AI
cnet

Apple Intelligence: What to Know About Apple's Gen AI

Apple Reveals InSight for TVOS
screenshot-2024-06-10-at-12-20-29pm.png

Apple Reveals InSight for TVOS

Apple Introduces Private Cloud Compute for AI Processing
ipados-00-09-14-29-still003

Apple Introduces Private Cloud Compute for AI Processing

OpenAI's ChatGPT Is Coming to Apple Apps
screenshot-2024-06-10-at-20-01-28.png

OpenAI's ChatGPT Is Coming to Apple Apps

Apple Redesigns Siri With AI and Glowing Borders
siripic

Apple Redesigns Siri With AI and Glowing Borders

Apple Updates Health Features With New Watch OS 11
240612-wwdc-watch-os-11

Apple Updates Health Features With New Watch OS 11