Google reveals 3D video chat with Project Starline

There is no substitute for being together in the room with someone. So several years ago, we kicked off a project to use technology to explore what's possible. We call it Project Starline. It builds on the different areas of computer science I spoke about today. And relies on custom built hardware and highly specialized equipment. It's early and currently available in just a few of our offices. But we thought it'd be fun to give you a look at people experiencing it for the first time. Let's take a look. When I walked into the room, I was a little suspicious. What is this I couldn't quite understand what was gonna happen when that screen lit up. Eddie [LAUGH] So you look beautiful.>> I could feel her and see her. It was this like 3d experience. [BLANK_AUDIO] I just saw my sister shoes right in front of me. I really felt like she and I were in the same room. It was like she was here wow [MUSIC] [BLANK_AUDIO] [APPLAUSE] [APPLAUSE] Some key advances have made this experience possible. First, using high resolution cameras, and custom built depth sensors. We capture your shape and appearance from multiple perspectives and then fuse them together to create an extremely detailed, real time 3d model. The resulting data is huge many gigabits per second. To send this 3D imagery over existing networks, we develop novel compression and streaming algorithms that reduce the data by a factor of more than 100. And we have developed a breakthrough light field display that shows you the realistic representation. Someone's sitting right in front of you in three dimensions. As you move your head and body, or system or just the images to match your perspective, you can talk naturally gesture and make eye contact. It's as close as we can get to the feeling of sitting across from someone. as sophisticated as the technology is, It vanishes. So you can focus on what's most important. With project star line, we've brought together a set of advanced technologies with the goal of creating the best communications experience possible. We have spent thousands of hours testing it in our own offices, and the results are promising. There's also excitement from our lead enterprise partners. We plan to expand access to partners in healthcare, and media. In pushing the boundaries of remote collaboration, we have made technical advances that will improve our entire suite of communications products. We look forward to sharing more ways for you to get involved in the months ahead.