Scientists at Oxford say they've invented an artificial intelligence system that can lip-read better than humans

Sophie Raworth

The system, which has been trained on thousands of hours of BBC News programmes, has been developed in collaboration with Google's DeepMind AI division.

"Watch, Attend and Spell", as the system has been called, can now watch silent speech and get about 50% of the words correct. That may not sound too impressive - but when the researchers supplied the same clips to professional lip-readers, they got only 12% of words right.

Joon Son Chung, a doctoral student at Oxford University's Department of Engineering, explained to me just how challenging a task this is. "Words like mat, bat and pat all have similar mouth shapes." It's context that helps his system - or indeed a professional lip reader - to understand what word is being spoken.

"What the system does," explains Joon, "is to learn things that come together, in this case the mouth shapes and the characters and what the likely upcoming characters are."

The BBC supplied the Oxford researchers with clips from Breakfast, Newsnight, Question Time and other BBC news programmes, with subtitles aligned with the lip movements of the speakers. Then a neural network combining state-of-the-art image and speech recognition set to work to learn how to lip-read.

After examining 118,000 sentences in the clips, the system now has 17,500 words stored in its vocabulary. Because it has been trained on the language of news, it is now quite good at understanding that "Prime" will often be followed by "Minister" and "European" by "Union", but much less adept at recognising words not spoken by newsreaders.

A lot more work needs to be done before the system is put to practical use, but the charity Action on Hearing Loss is enthusiastic about this latest advance.

"AI lip-reading technology would be able to enhance the accuracy and speed of speech to text," says Jesal Vishnuram, the charity's technology research manager. "This would help people with subtitles on TV, and with hearing in noisy surroundings."

Right now the system has limitations - it canhttp://www.bbc.com/news/technology-39298199

Comment

You need to be a member of 12160 Social Network to add comments!

Join 12160 Social Network

"Destroying the New World Order"

TOP CONTENT THIS WEEK

THANK YOU FOR SUPPORTING THE SITE!

mobile page

12160.info/m

12160 Administrators

 

Latest Activity

Doc Vega posted blog posts
5 hours ago
Doc Vega posted a photo

main-qimg-5806e1adb3109cf42e236b6063e7e3ec

The cowardly murderous Democrats out to destroy America.
7 hours ago
Sandy posted videos
9 hours ago
Burbia commented on Sandy's photo
Thumbnail

FB_IMG_1710523455761

"Is that the narrative now? Its more like Tik Tok influenced the younger generation to not be…"
21 hours ago
Burbia commented on Less Prone's photo
Thumbnail

Rebuilding Khazaria

"Who exactly are these beings? They violently push their way into the Middle East claiming it their…"
21 hours ago
Less Prone posted a photo

Famine or War What Would it Be

How far are these monsters allowed to go?
yesterday
Less Prone favorited cheeki kea's blog post The saddest post I've ever read. ( vaccine victim speaks out. )
yesterday
Less Prone commented on cheeki kea's blog post The saddest post I've ever read. ( vaccine victim speaks out. )
"It's so cruel and unfair. So many innocent people fell for it and even now the wictims are…"
yesterday
Doc Vega commented on truth's video
Thumbnail

MSM Admits US Funding Al-Qaeda & Taliban Terror Attacks

"In all likelihood if the MSM comes up with an explanation it's probably pure unadulterated…"
yesterday
Doc Vega commented on truth's video
Thumbnail

MSM Admits US Funding Al-Qaeda & Taliban Terror Attacks

"Mark Levin talks about all the front groups funded by Soros that have provided revenue for the…"
yesterday
Doc Vega favorited cheeki kea's blog post The saddest post I've ever read. ( vaccine victim speaks out. )
yesterday
Doc Vega commented on cheeki kea's blog post The saddest post I've ever read. ( vaccine victim speaks out. )
"Sad, but this is the fate of those who don't take heed and refuse to do their due diligence…"
yesterday
Doc Vega posted blog posts
yesterday
cheeki kea commented on Sandy's photo
Thumbnail

FB_IMG_1710523455761

"Hi Thia I'm back with news.... gvmnt will not protect you from Tick Tock, at this point it…"
yesterday
cheeki kea commented on cheeki kea's blog post Dr. Aseem Malhotra's Explosive Court Testimony on COVID "Vaccines"(UPDATED)
"More news dripping out from this story. ( found on Slay news…"
yesterday
cheeki kea commented on cheeki kea's blog post The saddest post I've ever read. ( vaccine victim speaks out. )
yesterday
cheeki kea posted a blog post

The saddest post I've ever read. ( vaccine victim speaks out. )

You know what, I think if God had a message for us here it would be the one that goes... Be as Wise…See More
yesterday
Burbia commented on Burbia's group The Comment Section is Closed
"So far, there are 14 comments here for the video about Iran's influence on Generation Z and…"
Wednesday
tjdavis posted videos
Wednesday
tjdavis posted photos
Wednesday

© 2024   Created by truth.   Powered by

Badges  |  Report an Issue  |  Terms of Service

content and site copyright 12160.info 2007-2019 - all rights reserved. unless otherwise noted