The $2,900 Sony Aibo comes equipped with facial recognition cameras and always-listening microphones. So just how much of your personal data is it lapping up?
Ry CristSenior Editor / Reviews - Labs
Originally hailing from Troy, Ohio, Ry Crist is a writer, a text-based adventure connoisseur, a lover of terrible movies and an enthusiastic yet mediocre cook. A CNET editor since 2013, Ry's beats include smart home tech, lighting, appliances, broadband and home networking.
ExpertiseSmart home technology and wireless connectivityCredentials
10 years product testing experience with the CNET Home team
At $2,900, Sony's robot dog Aibo sits at the fringe of technology, but it might not stay there. Whether you find it cute or creepy, the tech that makes Aibo tick is continuing to evolve, and it isn't hard to imagine a whole litter of less expensive Aibo competitors aimed at consumers -- and even at children -- in the not-so-distant future.
To be clear, Aibo's tech already includes artificial intelligence, sensors and microphones that help it interact with people, and cameras that can recognize faces and help it navigate your home like a Roomba. A reasonable consumer might rightly wonder just how much data this dog gathers as it wanders their home scanning faces and learning about its owners. Perhaps more important -- what exactly does Sony do with that data?
Watch this: How robots like Aibo play to your emotions
Sensors:Time-of-Flight sensor, 2 ranging sensors, pressure-sensitive/capacitive back sensor, capacitive head/jaw sensor, 6-axis detection systems (3-axis gyro/3-axis acceleration) in both head and torso, motion sensor, light sensor, 4 Paw Pads
Terminals: Charging pins, SIM card slot
Communications: LTE Data transmission, 2.4GHz Wi-Fi (802.11 b/g/n)
Accessories: Charging station (stand/mat), AC adapter, power cord, pink ball, SIM card
Aibo is clearly a sophisticated product -- both in its ability to use sensors, cameras and robotics to navigate your home, but also in the way it leverages artificial intelligence to learn about its owners, and build an emotional connection with them, even.
What Aibo (and Sony) learn about you
A person or a product -- or, for that matter, a company -- can't get to know somebody without getting to know things about them. And, sure enough, Aibo is designed to learn about you and adapt to you as you live with it. That means that it's gathering data about you.
There are legitimate privacy concerns about the products in our homes that gather data about us, says Kathleen McGee, former bureau chief of Internet & Technology for the New York Attorney General's office. That's because user information isn't just something that data-hungry devices like these need in order to function -- it's another commodity that the company can sell.
"The problem with that second purpose is that [information] is bundled and sold in ways that the consumer is not necessarily aware of or may not approve of if she knew about them," McGee says. "What if I'm on a health care regimen with my doctor and I cheat on my diet? Am I now going to be profiled for insurance companies in a less than attractive way?"
"We may share non-Personal Information, such as aggregate user statistics, demographic information, hashed or otherwise de-identified data, and Usage Information with third parties freely in our discretion for a variety of purposes, including tailoring promotions, advertising and communications we present to you."
"Hashed user data may be problematic," says Lorrie Cranor, director of Carnegie Mellon University's CyLab and a professor in security and privacy technologies. "If two companies use the same approach to hashing a user's identifier, then they will both end up with the same hash for that user and they will be able to match up their data and combine it into a single profile. They may or may not know who the user is, but they will be able to profile this user and target ads to them based on information in their profiles."
"[Sony collects] IP addresses and unique device identifiers but they don't treat this as personal information," Cranor added. "This is information that could be used to identify people, but they're not treating it as personal information. That's a little concerning."
With all of that in mind, let's take a look at the specific data Aibo collects:
Aibo uses its onboard microphones to hear commands -- but unlike other voice-activated devices like the Amazon Echo Dot or Google Nest Hub that record audio snippets and send them to the cloud to process an appropriate response, Aibo processes that microphone data itself using its built-in quad-core CPU.
"Aibo does not record audio," a Sony representative tells CNET. "In the same way that many voice-activated products listen for a verbal cue to react, Aibo's tricks are triggered by recognized verbal commands, such as 'sit' or 'shake.' Unlike many common household voice-activated products that primarily draw information from the cloud, the code enabling Aibo's tricks is stored locally within Aibo."
"We may collect Usage Information through the Aibo Product, including information about the device itself and information the Aibo Product collects through its microphone and camera (to assist your interactions with Aibo) such as data on voice commands the Aibo Product receives and how it interprets and responds to those commands (including both the content of the command and the tone/manner in which it is delivered)..."
In other words, even if Sony can't listen to your Aibo commands, it can still see what you're saying, as well as information about how Aibo interpreted your tone.
"That seems like fairly sensitive information," says Cranor.
The camera on Aibo's back is there to help it navigate your home by mapping your ceilings -- a trick that robot vacuums have been employing for years. The camera on Aibo's nose helps with navigation, as well, but its main purpose is to help Aibo interact with people.
"In order to mimic the behavior of an actual pet, an Aibo device will learn to behave differently around familiar people," reads a statement on Sony's support page. "To enable this recognition, Aibo conducts a facial analysis of those it observes through its cameras."
"This facial-recognition data may constitute 'biometric information' under the law of Illinois, which places specific obligations on parties collecting biometric information. Thus, we decided to prohibit purchase and use of Aibo by residents of Illinois."
Sony tells CNET that Aibo's facial recognition functionality is based on the sensing and measurement of facial features, and by detecting specific expressions, too, including smiles.
"Aibo also learns its surroundings by sensing and measuring elements of its physical environment, as well as its proximity to those elements," Sony says. "This data, which is stored both locally on Aibo and in the cloud, is intended to support and enhance Aibo's functionality, help Aibo find its charging station, as well as to protect Aibo from collisions with household objects."
So, in addition to tracking facial recognition data that can be used to identify you, Aibo collects details about the layout of your home too.
"Positional and facial recognition data is used to support and enhance Aibo's functionality, and it is not provided to third parties," Sony tells CNET.
Another feature worth mentioning is called Aibo Patrol. Turn it on, and the dog will keep a log of its interactions with each face it recognizes.
"It seems like you can basically stalk the people in your house, or have the dog stalk them for you," Cranor noted, "and the owner can then get information about their interactions with the dog, or when the dog sees them."
Aibo Patrol also asks for personal info like names and birthdays for each person you're tracking in order to personalize the experience. All of that information is stored both in the device and in Sony's cloud.
"They say it's not designed for children," she told me, "which, I guess... at the same time, it's a dog. It's hard to think that children wouldn't be using it."
Aibo can take photographs and store those in Sony's cloud, too. A representative for Sony described that feature to CNET when asked about the specific data gathered by Aibo's camera, saying, "There is a feature enabling users to take still photographs, which are stored in the cloud and managed by users via the My Aibo app. The photo feature is turned off by default and the user has to enable that functionality."
"In the event that an owner elects to enable this function, the Aibo Product will automatically capture up to 30 photographs per day using its internal cameras. After taking the photographs, the Aibo Product will analyze them, select a portion of the photographs it considers "best" (evaluating factors such as presence and position of human subjects, whether subjects are smiling, time of day, and other qualities it learns as it interacts with you), and upload those selected photos to the owner's My Aibo online account. The remaining photos will be deleted by the Aibo Product."
"No electronic data transmission or storage of information can be guaranteed to be 100% private and secure," the policy's security section reads. "Please be careful to avoid 'phishing' scams, where someone may send you an e-mail that looks like it is from Sony asking for your Personal Information."
Can I delete my data?
Yes -- but you'll need to erase your Aibo's memory and restore it to its default factory settings. In other words, there's really no way to use Aibo as intended without sharing data.
And, with more and more data-gathering devices seeking places in our homes -- and with US privacy laws lagging behind Europe, where the General Data Protection Regulation (GDPR) has already seen major tech firms make big changes to their policies -- a product like Aibo only highlights the need for a larger public conversation about private data and the companies that collect it.
"It's becoming difficult to find companies that say 'we only use this information for operational purposes, we never sell it," says McGee. That's understandable, she adds -- companies have to appease shareholders and make sure that they're exploring every potential business possibility.
There's a "but," though.
"If they think that the consumer wouldn't use their product if the consumer understood what was happening, then maybe they shouldn't be doing it."