Researchers can Read Emotions in MR Images

This discovery is the first to reveal that emotional information is represented by distinct spatial signatures in the brain that can be generalized across speakers.

"Correct interpretation of emotion in the voice is highly important--particularly in a modern environment where visual emotional signals are often not available,” for instance, when people talk on the phone, stated Dr. Thomas Ethofer, from the University of Geneva (Switzerland). "We demonstrated that the spatial pattern of activity within the brain area that processes human voices contains information about the expressed emotion.”

Earlier neuroimaging research demonstrated that voice-sensitive auditory areas activate to a wide range of vocally expressed emotions more than to neutral speech melody, the researchers explained. However, this enhanced response occurs irrespective of the specific category of emotion, making it impossible to distinguish different vocal emotions with conventional analyses.

In the new study, the researchers presented people with pseudowords spoken in five ways--with anger, sadness, relief, joy, or no emotion--while their brains were scanned with functional magnetic resonance imaging (fMRI) scanning. The researchers then analyzed the overall spatial pattern of activity in the auditory cortex by using a technique called multivariate pattern analysis. "While conventional methods analyze each point in the brain separately, we looked at the overall pattern,” Dr. Ethofer explained. "Consider the following analogy: If you have a puzzle consisting of black and white pieces, it is hard to say whether they belong to a picture of a zebra or a checkerboard if you look at each piece in isolation, but it becomes relatively easy if you put the pieces together.”

In fact, the analysis showed that they could classify each emotion against all other alternatives. The findings have not only provided new clues into this most vital of social skills, but they might also help researchers unravel where it goes wrong in those with various psychiatric disorders, Dr. Ethofer reported. "Comprehension of emotional prosody is crucial for social functioning and compromised in various psychiatric disorders, including deficits for anger and sadness in schizophrenia, fear, and surprise in bipolar affective disorder, and surprise in depression,” the researchers wrote in their study, which was reported online on May 14, 2009, issue of the journal Current Biology. "Future research might apply a similar approach as ours to clarify whether these deficits are paralleled by activity changes blurring emotions at the level of auditory cortex, or are due to disrupted patterns within frontal regions reflecting biased interpretation of emotional signals.”

Related Links:
University of Geneva