Scientists at Oxford say they've invented an artificial intelligence system that can lip-read better than humans

Sophie Raworth

The system, which has been trained on thousands of hours of BBC News programmes, has been developed in collaboration with Google's DeepMind AI division.

"Watch, Attend and Spell", as the system has been called, can now watch silent speech and get about 50% of the words correct. That may not sound too impressive - but when the researchers supplied the same clips to professional lip-readers, they got only 12% of words right.

Joon Son Chung, a doctoral student at Oxford University's Department of Engineering, explained to me just how challenging a task this is. "Words like mat, bat and pat all have similar mouth shapes." It's context that helps his system - or indeed a professional lip reader - to understand what word is being spoken.

"What the system does," explains Joon, "is to learn things that come together, in this case the mouth shapes and the characters and what the likely upcoming characters are."

The BBC supplied the Oxford researchers with clips from Breakfast, Newsnight, Question Time and other BBC news programmes, with subtitles aligned with the lip movements of the speakers. Then a neural network combining state-of-the-art image and speech recognition set to work to learn how to lip-read.

After examining 118,000 sentences in the clips, the system now has 17,500 words stored in its vocabulary. Because it has been trained on the language of news, it is now quite good at understanding that "Prime" will often be followed by "Minister" and "European" by "Union", but much less adept at recognising words not spoken by newsreaders.

A lot more work needs to be done before the system is put to practical use, but the charity Action on Hearing Loss is enthusiastic about this latest advance.

"AI lip-reading technology would be able to enhance the accuracy and speed of speech to text," says Jesal Vishnuram, the charity's technology research manager. "This would help people with subtitles on TV, and with hearing in noisy surroundings."

Right now the system has limitations - it canhttp://www.bbc.com/news/technology-39298199

Comment

You need to be a member of 12160 Social Network to add comments!

Join 12160 Social Network

"Destroying the New World Order"

TOP CONTENT THIS WEEK

THANK YOU FOR SUPPORTING THE SITE!

mobile page

12160.info/m

12160 Administrators

 

Latest Activity

Snakedaddy favorited Less Prone's profile
yesterday
Tori Kovach left a comment for Less Prone
"Hello Less Prone, I am an infrequent visitor just to let you know. It is nice to know there are…"
yesterday
Tori Kovach and Less Prone are now friends
yesterday
Doc Vega's 5 blog posts were featured
yesterday
tjdavis's blog post was featured
yesterday
Less Prone favorited tjdavis's video
yesterday
Less Prone favorited cheeki kea's photo
yesterday
Less Prone favorited tjdavis's photo
yesterday
Less Prone posted a blog post

🚨 **SCAM ALERT: Fake "Abiola Bawuah" Emails Circulating** 🚨

Be warned about an active impersonation scam using the name **"Abiola Bawuah"**—a real Ghanaian…See More
yesterday
Less Prone favorited Snakedaddy's profile
yesterday
Less Prone commented on Less Prone's video
Thumbnail

🔴 LIVE in English: COVID Shots Dutch Court Hearing vs Bill Gates, Pfizer et al. — Oct 22

"Yes Doc, it was. And the politicians keep quiet about the whole thing. It's a crime. We live…"
yesterday
Doc Vega commented on Less Prone's video
Thumbnail

🔴 LIVE in English: COVID Shots Dutch Court Hearing vs Bill Gates, Pfizer et al. — Oct 22

"The whole thing was a global set-up, weaponizing the medical industry to socially engineer the…"
Tuesday
Doc Vega favorited Less Prone's video
Tuesday
Doc Vega posted blog posts
Tuesday
Less Prone posted a video

🔴 LIVE in English: COVID Shots Dutch Court Hearing vs Bill Gates, Pfizer et al. — Oct 22

Technical difficulties in the intro resolved! Thanks for hanging in there everyone!🗣 BE PART OF THE PUBLIC RECORD. The court won't publish a recording of t...
Tuesday
Doc Vega favorited tjdavis's video
Tuesday
Doc Vega commented on tjdavis's video
Thumbnail

COLOSSUS: THE FORBIN PROJECT Official Trailer (1970, Eric Braeden, Susan Clark, Joseph Sargent)

"I'm afraid that this is exactly what AI will become! I wacthed this movie a long time agao and…"
Tuesday
Doc Vega commented on Doc Vega's blog post The Fantasy Clown World I Wake Up to Everyday
"cheeki kea, thanks for your support! "
Tuesday
tjdavis posted a video

COLOSSUS: THE FORBIN PROJECT Official Trailer (1970, Eric Braeden, Susan Clark, Joseph Sargent)

Theatrical trailer of "Colossus: The Forbin Project" by Joseph Sargent. Starring Eric Braeden, Susan Clark, Gordon Pinsent, William Schallert, Leonid Rostoff...
Tuesday
tjdavis posted a video

In 1994, He Exposed Their Entire System… and Predicted 2026 Perfectly. | Jordan Maxwell

In 1994, He Exposed Their Entire System… and Predicted 2026 Perfectly. | Jordan Maxwell#jordanmaxwell #knowledge #technology #history #facts✅ Explore Jordan ...
Sunday

© 2026   Created by truth.   Powered by

Badges  |  Report an Issue  |  Terms of Service

content and site copyright 12160.info 2007-2019 - all rights reserved. unless otherwise noted