Andy Serkis talks about the evolution of motion capture
4:21

Andy Serkis talks about the evolution of motion capture

TV & Movies
[MUSIC] How have you seen just how technology has helped evolve storytelling from your perspective? Well, if we go back right back to the beginning to Lord of the Rings. The essential. The thing that was discovered on that was that Peter Jackson had this idea that up to that point visual effects were imagined. They were imagined by other actors in real shooting or on live sets. So they had to imagine that there was a dragon there or a threatening beast or whatever it was. And Peter Jackson did not want the actors playing Sam and Frodo to have to imagine what Gollum was doing, so he wanted to have an actor on set play that character. And then, the performance capture, or as it was called in those days, motion capture, was beginning to emerge as a tool. But that was the And sort of the main tipping point was this moment where we suddenly went from a visual effect becoming a real character and that was having an actor to play the role. So I would go and shoot on set with my fellow actors on live sets and live locations but I would always have to go back and repeat the plates. The empty plate who would shoot Both with the actors, and then we'd have empty plates shot. I'd have to go then back and populate those empty plates using motion capture on my own in the studio. The significant changes over the course of the next 17 years was such that when we went back to work on King Kong. We started to use facial capture so I had 130 markers stuck to my face but it was still in a controlled environment. It was still in the motion capture stage. Then in between those films. We started working on Tintin and at the same time Avatar was happening. And at that time it freed up the actors to work in the volume wearing head mounted cameras so that you're fully free to move the 360 degrees. Was being captured and the next big shifting technology was taking all of that and then placing on a live action film set so that you didn't ever have to go back and repeat it, that we could catch everything in the moment so acting opposite your live is I've always done but had to repeat it. This now we have the technology to put the performance capture cameras in the same room as real film cameras and lighting and get the whole thing all in one hit. So that was the sort of the progression. Are you still blown away by any of the evolutions that have happened? Maybe things that are like, I didn't think this could happen. Or has it kind it happened how you thought it would? I mean, the essence of it hasn't changed hugely. But what has changed is the artistry that goes with it, the software, the engineering, and the rendering, and all of that that makes it feel more photo real. But also the artistry in the sense that I've now been working with that team for, over the course of 17 years. So they fully understand what it is to honor the actor's performance. And to try and emulate it exactly. And through all of the new software and code that's been written to make it look photoreal. Then you've got to actually. You know, because what the director is working with in the cut is the performance that he shot on the day. So, my face will live in the cut for months and months and months. When they come to make Caesar's face work, there is this artistry of bringing Caesar's face, putting it next to mine and going, well, okay. The first part animation shows, you know what Andy's doing, is he's being angry but there's some vulnerability. But we've already seen the anger there. So there's literally 120 iterations per shot until you're exactly matching the authored performance by the actor. so that's so you see those shots start to come through, you know, those have improved. Dramatically over the last, certainly throughout the course of making these three movies. [BLANK_AUDIO]

Up Next

Deepfake Expert Reacts to Viral Deepfakes
deepfake-3

Up Next

Deepfake Expert Reacts to Viral Deepfakes

Apple WWDC 2022 Preview
wwdc-preview-00-01-51-17-still006

Apple WWDC 2022 Preview

F50 Hydrofoils: Racing The World's Most Advanced Sailboats
fd1-2772

F50 Hydrofoils: Racing The World's Most Advanced Sailboats

Why I'm More Excited for a New Apple Watch SE Than the Series 8
yt-apple-watch-se-n-8-v4

Why I'm More Excited for a New Apple Watch SE Than the Series 8

Gene Simmons talks about 50 years of Kiss Mania
gettyimages-1360277643

Gene Simmons talks about 50 years of Kiss Mania

Why Apple Should Launch an iPhone Subscription Plan
heres-which-iphone-you-should-buy-in-2022-mp4-00-00-07-17-still002

Why Apple Should Launch an iPhone Subscription Plan

2022 iPhone SE Disappoints in Drop Test
yt-iphone-se-drop-test-v3

2022 iPhone SE Disappoints in Drop Test

Disney's Galactic Starcruiser: What It's Really Like Inside the Star Wars Hotel
Disney Star Wars Galactic Starcruiser Hotel

Disney's Galactic Starcruiser: What It's Really Like Inside the Star Wars Hotel

Meet Rocki, the robot companion for pets
rockirobot-youtube-00-04-50-14-still007

Meet Rocki, the robot companion for pets

Tech Shows

The Apple Core
apple-core-w

The Apple Core

Alphabet City
alphabet-city-w

Alphabet City

CNET Top 5
cnet-top-5-w

CNET Top 5

The Daily Charge
dc-site-1color-logo.png

The Daily Charge

What the Future
what-the-future-w

What the Future

Tech Today
tech-today-w

Tech Today

Latest News All latest news

Deepfake Expert Reacts to Viral Deepfakes
deepfake-3

Deepfake Expert Reacts to Viral Deepfakes

Fun Amazon Finds Under $50 (July 2022)
amazonjuly2022-master-00-11-19-15-still001

Fun Amazon Finds Under $50 (July 2022)

Auto Giant Magna Prepares to Make Every Part of a Car Light Up
magna-lighting-00-01-55-05-still131

Auto Giant Magna Prepares to Make Every Part of a Car Light Up

How to Find Cheap Flights
airlinetickets-master-00-05-36-21-still003

How to Find Cheap Flights

The iPhone at 15: How Apple's Phone Became the Center of Your Life
yt-applestuff-ep02-v6

The iPhone at 15: How Apple's Phone Became the Center of Your Life

How to Play Games from PlayStation Plus on PC
psstill

How to Play Games from PlayStation Plus on PC

Most Popular All most popular

How to Find Cheap Flights
airlinetickets-master-00-05-36-21-still003

How to Find Cheap Flights

Fun Amazon Finds Under $50 (July 2022)
amazonjuly2022-master-00-11-19-15-still001

Fun Amazon Finds Under $50 (July 2022)

The iPhone at 15: How Apple's Phone Became the Center of Your Life
yt-applestuff-ep02-v6

The iPhone at 15: How Apple's Phone Became the Center of Your Life

Deepfake Expert Reacts to Viral Deepfakes
deepfake-3

Deepfake Expert Reacts to Viral Deepfakes

SpyraTwo hands-on: The ultimate water gun
spyratwo-2

SpyraTwo hands-on: The ultimate water gun

What's New to Stream for June 2022
netpicks-june-2022thumb

What's New to Stream for June 2022

Latest Products All latest products

E Ink Tablets: Everything You Need to Know
eink-website

E Ink Tablets: Everything You Need to Know

Moto G 5G Review: A $400 Phone That May Have Everything You Need
clip0001-00-00-25-15-still001

Moto G 5G Review: A $400 Phone That May Have Everything You Need

Hands-On: We Got to Try the Sony Xperia 1 IV and Its Zoom Lens
xperiafinalpicsite

Hands-On: We Got to Try the Sony Xperia 1 IV and Its Zoom Lens

Lenovo Legion 7 Gaming Laptops Combine Great Power With Simple, Slim Designs
lenovolegion-00-00-45-13-still003

Lenovo Legion 7 Gaming Laptops Combine Great Power With Simple, Slim Designs

Exploring Meta Store: Facebook Parent Meta's First Physical Retail Space
metastore

Exploring Meta Store: Facebook Parent Meta's First Physical Retail Space

Lenovo's Torrent of Slim-Series Laptops Has Almost Too Many Options
lenovoslim-00-00-03-10-still001.png

Lenovo's Torrent of Slim-Series Laptops Has Almost Too Many Options

Latest How To All how to videos

How to Play Games from PlayStation Plus on PC
psstill

How to Play Games from PlayStation Plus on PC

How to Delete or Disable Your Instagram Account
phoneonorange

How to Delete or Disable Your Instagram Account

Fix Your iPhone Screen With Apple's Self-Service Repair Kit
dsc00641

Fix Your iPhone Screen With Apple's Self-Service Repair Kit

How to Buy a Budget Laptop in 2022
budgetlaptops-00-08-35-15-still001

How to Buy a Budget Laptop in 2022

Google Pay: How to Set Up and Use
googlepay-inhand

Google Pay: How to Set Up and Use

Clean Your AirPods and EarPods Without Damaging Them
yt-howto-clean-airpods-v3

Clean Your AirPods and EarPods Without Damaging Them