11th Annual Conference of the International Speech Communication Association

Makuhari, Chiba, Japan
September 26-30. 2010

Towards Affective State Modeling in Narrative and Conversational Settings

Bart Jochems (1), Martha Larson (2), Roeland Ordelman (1), Ronald Poppe (1), Khiet P. Truong (1)

(1) University of Twente, The Netherlands
(2) Technische Universiteit Delft, The Netherlands

We carry out two studies on affective state modeling for communication settings that involve unilateral intent on the part of one participant (the evoker) to shift the affective state of another participant (the experiencer). The first investigates viewer response in a narrative setting using a corpus of documentaries annotated with viewer-reported narrative peaks. The second investigates affective triggers in a conversational setting using a corpus of recorded interactions, annotated with continuous affective ratings, between a human interlocutor and an emotionally colored agent. In each case, we build a “one-sided” model using indicators derived from the speech of one participant. Our classification experiments confirm the viability of our models and provide insight into useful features.

Full Paper

Bibliographic reference.  Jochems, Bart / Larson, Martha / Ordelman, Roeland / Poppe, Ronald / Truong, Khiet P. (2010): "Towards affective state modeling in narrative and conversational settings", In INTERSPEECH-2010, 490-493.