CROSS-MODAL PERCEPTION OF EMOTIONAL SPEECH

Pashiera Barkhuysen, Emiel Krahmer & Marc Swerts
University of Tilburg

ID 1482
[full paper]

We report on a perception experiment in which Czech participants rate the perceived emotional state of Dutch speakers. These speakers could either display a positive or a negative emotion, which was either real or acted. The Czech participants were confronted with these utterances, which they could not understand, in a bimodal (audiovisual) or a unimodal (audio or vision only) condition. It was found that acted emotional speech leads to significantly more extreme perceived emotion scores than non-acted emotional speech, where the difference between acted and real emotional speech is stronger for the negative than for the positive conditions. Interestingly, the biggest overall differences between acted and non-acted emotions were found for the audio-only condition, which suggests that acting has a particularly strong effect on the spoken realization of emotions.