8th Annual Conference of the International Speech Communication Association

Antwerp, Belgium
August 27-31, 2007

Visualizing Acoustic Similarities Between Emotions in Speech: An Acoustic Map of Emotions

Khiet P. Truong, David A. van Leeuwen

TNO Human Factors, The Netherlands

In this paper, we introduce a visual analysis method to assess the discriminability and confusability between emotions according to automatic emotion classifiers. The degree of acoustic similarities between emotions can be defined in terms of distances that are based on pair-wise emotion discrimination experiments. By employing Multidimensional Scaling, the discriminability between emotions can then be visualized in a two-dimensional plot that is relatively easy to interpret. This ‘map of emotions’ is compared to the well-known ‘Feeltrace’ two-dimensional mapping of emotions. While there is correlation with the ‘arousal’ dimension of Feeltrace, it appears that the ‘valence’ dimension is difficult to relate to the acoustic map.

Full Paper

Bibliographic reference.  Truong, Khiet P. / Leeuwen, David A. van (2007): "Visualizing acoustic similarities between emotions in speech: an acoustic map of emotions", In INTERSPEECH-2007, 2265-2268.