Computer Software decodes emotions over the phone, predicts behavior


By Eric Bland | DiscoveryNews.com

The innovative program can not only predict a caller’s emotional state, but may also diagnose a range of medical conditions.

Less than two minutes into a cell phone conversation, a new computer program can predict a broken heart -- literally and figuratively.

An Israeli company called eXaudios has developed a computer program, known as Magnify, that decodes the human voice to identify a person’s emotional state.

Some companies in the United States already use the system in their call centers. eXaudios is even testing the software’s use in diagnosing medical conditions like autism, schizophrenia, heart disease and even prostate cancer.

"When agents talk with customers over the phone, they usually focus on content and not intonation, unless the customer is screaming," said Yoram Levanon, President and CEO of eXaudios, which recently won a $1 million prize at the Demo 2010 conference. "If a customer is screaming, you don’t need the software. But if we can identify the other emotions of a customer, we can save customers and companies money."

A number of companies sell software that analyzes conversations between a customer service agent and a customer after the conversation is over. Magnify monitors a phone call in real time. The program then lists the caller’s emotions on screen.

When Discovery News’ technology correspondent’s voice was decoded using the Magnify software, the output read like a psychologist’s notebook: "Struggling to contain an inner excitement. Keeping emotions and/or creativity in check. Warm and fuzzy."

In a call center, the Magnify system then suggests various tactics to a customer service representative, depending on the needs of the company.

If a person is interested in a company’s product or service, the software suggests various ways a customer service agent can pitch it. Magnify can also tell if a person is unlikely to buy and suggest the agent end the conversation before angering the client. The program can even predict when a customer will start yelling up to one minute before it happens, said Magnify’s SVP of Business Operations, Alon Klomek.

It’s taken eXaudios well over a decade to develop Magnify, said Levanon. Magnify works by teasing apart a person voice, separating the frequencies and measuring various qualities of those wavelengths, such as their intonation and intensity.

Magnify is not 100 percent accurate, however. Between 17 percent and 24 percent of the time Magnify fails to identify a caller’s correct emotions.

"We tried to find physical rules that explained why we were wrong," said Levanon. "What we found was that there was a medical reason we were wrong."

Certain diseases have an unmistakable impact on a person’s speech. Many autistic patients require speech therapy to communicate effectively. Nearly 90 percent of Parkinson’s disease patients eventually develop some form of soft, mumbled speech.

Yoram Bonneh, an autism researcher at the Weizman Institute of Science in Israel, used the Magnify software in his work with autistic five-year-old children. Out of 80 children -- 40 previously diagnosed with autism and 40 non-autistic children -- Magnify successfully identified 85 percent of the autistic kids.

These were children with very mild forms of autism, said Bonneh. "They can speak, and when you listen to them you cannot tell a difference (between the autistic and non-autistic children)," said Bonneh. "But when you analyze their voices, you find differences that are significant, which allows us to classify a child as autistic or not."

In addition to Bonneh’s autism study, eXaudios cites other research in Parkinson’s disease, schizophrenia, heart disease and dyslexia. The company even has anecdotal evidence that they can diagnose prostate cancer by analyzing a person’s voice. According to Levanon, a person with prostate cancer has a "Grand Canyon" of missing tones that is "catastrophic to the voice."

eXaudios is not the only group that has linked a person’s voice to a medical condition. Cogito Health, a Boston-based company, already uses software originally developed by Alex Pentland of the Massachusetts Institute of Technology to diagnose depression in patients, and more recently, for patient drug compliance and post traumatic stress syndrome.

Analyzing a person’s voice to gain clues about their health and emotional state is nothing new, said Pentland. Humans do it all the time. The computer is just doing a better job at voice analysis than most people because it largely ignores content and focuses on form.

Whether a computer or human is analyzing a conversation, however, "it’s not what you say," said Pentland. "It’s how you say it."

Views: 58

Reply to This

Replies to This Discussion

interesting keisha, i can keep that in mind i appreciate that comment we all can get updates for each other its the only way to win the war

Keisha said:
James, you should seriously run your own news site like this one but perhaps more formatted to the likes of worldaffairsbreif.com as an example.

Personally I LOVE getting updates from you here about the current news because you know how to pick out whats important.

RSS

"Destroying the New World Order"

TOP CONTENT THIS WEEK

THANK YOU FOR SUPPORTING THE SITE!

mobile page

12160.info/m

12160 Administrators

 

Latest Activity

Doc Vega commented on Doc Vega's blog post Was a Planned Civil War Averted?
"cheeki kea, you are spot on. The old guard is about to collapse! "
11 hours ago
Doc Vega commented on Doc Vega's blog post Alligator Creek and a Japanese Massacre
"cheeki kea, the Japanese thought they could expand their empire and exact enough damage on the US…"
11 hours ago
Michelle Reichert favorited Burbia's video
yesterday
cheeki kea posted a video

NEW DOCUMENTARY - Dissent Into Madness

TRANSCRIPT AND SOURCES: https://www.corbettreport.com/dissent-into-madness/What if the delusions of the dissidents are in fact real? What if their paranoid f...
yesterday
cheeki kea commented on Doc Vega's blog post Alligator Creek and a Japanese Massacre
"Japan served themselves up no favours by inching out into the South Pacific as they soon found out.…"
yesterday
cheeki kea commented on Doc Vega's blog post Was a Planned Civil War Averted?
"Their plans did not work out because we are the news now, and the old news is the enemy. "
yesterday
Doc Vega posted a blog post

Alligator Creek and a Japanese Massacre

The year is 1942 just a few months after the Pearl Harbor disaster. Despite losses suffered by the…See More
yesterday
Doc Vega commented on Burbia's video
Thumbnail

CHARLIE KIRK WAS CNP! JOSH REEVES 9-11-25

"With all due respect this guy comes off as a drunken asshole and he didn't even  know who…"
Monday
Doc Vega posted a blog post

Was a Planned Civil War Averted?

We are living in sadly historic times where good and evil are in battle all the time. Not that this…See More
Sunday
Sandy posted a photo
Sunday
Less Prone posted a video

President Trump addresses U.N. General Assembly - FULL SPEECH

President Donald Trump speaks at the United Nations General Assembly in New York City.Full video here: https://www.c-span.org/event/white-house-event/preside...
Sunday
Burbia posted a video

2 MIN AGO: Western Provinces MAJOR New WEXIT Announcement - Canada EXPLODES!

In a stunning turn of events, Western provinces just made a major new WEXIT announcement — and it’s shaking the foundations of Canadian unity. Is Western sep...
Saturday
Doc Vega posted a blog post

How You Provoke a Civil War

In the world of counter intelligence which is simply one aspect of many pertaining to asymmetrical…See More
Friday
Burbia commented on Burbia's video
Thumbnail

CHARLIE KIRK WAS CNP! JOSH REEVES 9-11-25

"I don't follow as much with Josh Reeves than I use to. He seems to be a documentary producing…"
Sep 25
Burbia posted a video

CHARLIE KIRK WAS CNP! JOSH REEVES 9-11-25

DONATE-paypal-dayglow76@yahoo.comCashapp-reevesradioVenmo-Josh-Reeves-61FILMS AND AUDIOBOOKS DOWNLOAD STORE-https://store.payloadz.com/results/242828-josh-re...
Sep 25
Doc Vega posted blog posts
Sep 25
tjdavis posted a video

CHARLIE KIRK VIDEO THAT KEEPS GETTING REMOVED OFF OF SEVERAL PLATFORMS

I had not planned to share this publicly, but I believe Advar, who spoke with Charlie Kirk while I was very ill, would have wanted me to. After my interview ...
Sep 25
pohonemas33 team commented on Chris of the family Masters's photo
Thumbnail

Gold-Coast-Message

"untuk bermain slot, kamu cukup kunjungi situs kacang99 pasti langsung gacor"
Sep 24
Doc Vega posted blog posts
Sep 24
Burbia posted a blog post

Former President Trump?

When was this article written? It is attributed to Victor Davis Hanson. He is a Fellow at Hoover…See More
Sep 22

© 2025   Created by truth.   Powered by

Badges  |  Report an Issue  |  Terms of Service

content and site copyright 12160.info 2007-2019 - all rights reserved. unless otherwise noted