Scientists at Oxford say they've invented an artificial intelligence system that can lip-read better than humans

Sophie Raworth

The system, which has been trained on thousands of hours of BBC News programmes, has been developed in collaboration with Google's DeepMind AI division.

"Watch, Attend and Spell", as the system has been called, can now watch silent speech and get about 50% of the words correct. That may not sound too impressive - but when the researchers supplied the same clips to professional lip-readers, they got only 12% of words right.

Joon Son Chung, a doctoral student at Oxford University's Department of Engineering, explained to me just how challenging a task this is. "Words like mat, bat and pat all have similar mouth shapes." It's context that helps his system - or indeed a professional lip reader - to understand what word is being spoken.

"What the system does," explains Joon, "is to learn things that come together, in this case the mouth shapes and the characters and what the likely upcoming characters are."

The BBC supplied the Oxford researchers with clips from Breakfast, Newsnight, Question Time and other BBC news programmes, with subtitles aligned with the lip movements of the speakers. Then a neural network combining state-of-the-art image and speech recognition set to work to learn how to lip-read.

After examining 118,000 sentences in the clips, the system now has 17,500 words stored in its vocabulary. Because it has been trained on the language of news, it is now quite good at understanding that "Prime" will often be followed by "Minister" and "European" by "Union", but much less adept at recognising words not spoken by newsreaders.

A lot more work needs to be done before the system is put to practical use, but the charity Action on Hearing Loss is enthusiastic about this latest advance.

"AI lip-reading technology would be able to enhance the accuracy and speed of speech to text," says Jesal Vishnuram, the charity's technology research manager. "This would help people with subtitles on TV, and with hearing in noisy surroundings."

Right now the system has limitations - it canhttp://www.bbc.com/news/technology-39298199

Comment

You need to be a member of 12160 Social Network to add comments!

Join 12160 Social Network

"Destroying the New World Order"

TOP CONTENT THIS WEEK

THANK YOU FOR SUPPORTING THE SITE!

mobile page

12160.info/m

12160 Administrators

 

Latest Activity

Doc Vega posted a blog post

Always Wondering

The face of reality pressed against your window paneIs it engineered or is it real rain?So, you…See More
17 hours ago
tjdavis favorited Burbia's video
yesterday
tjdavis posted a photo
yesterday
cheeki kea commented on cheeki kea's photo
yesterday
cheeki kea posted a photo
yesterday
rlionhearted_3 posted a photo
yesterday
Sandy posted photos
Thursday
james will posted a blog post

how to doanload mp3 online?

An MP3 downloader is a useful online tool that allows users to convert and download their favorite…See More
Wednesday
Doc Vega commented on rlionhearted_3's photo
Thumbnail

Another incredibly Stupid!! What, no mirrors?

"Personally , I go for the more classic forms of cosmetic surgery! "
Tuesday
Doc Vega posted blog posts
Tuesday
Less Prone favorited tjdavis's video
Tuesday
Less Prone commented on rlionhearted_3's photo
Thumbnail

Another incredibly Stupid!! What, no mirrors?

"When the problem is inside, it causes transformations like this. I like the original better. Maybe…"
Tuesday
Less Prone favorited james will's blog post YouTube Downloader Tools You Never Knew Existed
Tuesday
james will posted a blog post

YouTube Downloader Tools You Never Knew Existed

A YouTube downloader is an online tool or software that helps convert YouTube videos into…See More
Tuesday
tjdavis posted a video

Experimenter - Official Trailer

Like on Facebook: https://www.facebook.com/experimenterfilmYale University, 1961. Stanley Milgram (Peter Sarsgaard) designs a psychology experiment that stil...
Tuesday
Doc Vega posted a blog post

How Did the Soviets First Discover the SR-71 Blackbird?

Although President Lydon Johnson announced the development of the Lockheed SR-71 in 1964 which…See More
Sunday
Doc Vega commented on Burbia's blog post Disgraced Former CNN Anchor Don Lemon Arrested
"Personally, I don't consider Don Lemon or people like him to be journalists at all. They are…"
Sunday
tjdavis posted photos
Jan 31
tjdavis favorited Doc Vega's blog post The Forbidden Canyon and It’s Residents
Jan 31
tjdavis posted a video

The Farmer vs the Billionaire — Jeremy Clarkson Says NO to Bill Gates’ £100 Million Deal | UK News

OFFICIAL NOTICE: This channel is NOT Jeremy Clarkson, is not affiliated with him, and does not represent his official views or Diddly Squat Farm. This is an ...
Jan 31

© 2026   Created by truth.   Powered by

Badges  |  Report an Issue  |  Terms of Service

content and site copyright 12160.info 2007-2019 - all rights reserved. unless otherwise noted