Lip-reading computer can distinguish languages

Lip-reading computer from researchers in Britain is able to identify languages spoken with "high accuracy," according to scientists.

Watch what you say. Scientists in England have developed a computer that can not only read lips, but can tell the difference between languages.

Mouth movements can differ according to the language spoken. University of East Anglia

Researchers at the University of East Anglia's School of Computing Sciences developed the technology by statistically modeling the lip motions of 23 bilingual and trilingual speakers. The resulting system is able to identify the language spoken by an individual with "very high accuracy," according to the university. Identifiable languages included English, French, German, Arabic, Mandarin, Cantonese, Italian, Polish, and Russian.

What gives you away? The movement of your articulators--when you wag your tongue, jaw, and lips, you are generating the measurable characteristics of visual speech, the recognition of which is known as lip reading. Computer vision has already been used in lip reading, or "feature extraction," but this is the first time computers have been "taught" to recognize different languages, according to UEA (PDF).

"This is an exciting advance in automatic lip-reading technology and the first scientific confirmation of something we already intuitively suspected--that when people speak different languages, they use different mouth shapes in different sequences," said Professor Stephen Cox, who led the research along with Jake Newman. "For example, we found frequent 'lip rounding' among French speakers, and more prominent tongue movements among Arabic speakers."

The discovery could have practical uses for the deaf, law enforcement, and military units serving overseas, the researchers predict. With a little fine tuning it may also help you figure out what language your teenager speaks.

Featured Video
This content is rated TV-MA, and is for viewers 18 years or older. Are you of age?
Sorry, you are not old enough to view this content.

The WRT1900ACS is Linksys' new best Wi-Fi router to date

CNET editor Dong Ngo compares the new WRT1900ACS and the old WRT1900AC Wi-Fi routers from Linksys. Find out which one is better!

by Dong Ngo