INTERSPEECH 2012
13th Annual Conference of the International Speech Communication Association

Portland, OR, USA
September 9-13, 2012

A Sequential Bayesian Dialog Agent for Computational Ethnography

Abe Kazemzadeh, James Gibson, Juanchen Li, Sungbok Lee, Panayiotis G. Georgiou, Shrikanth Narayanan

Signal Analysis and Interpretation Lab, University of Southern California, Los Angeles, CA, USA

We present an sequential Bayesian belief update algorithm for an emotional dialog agentfs inference and behavior. This agentfs purpose is to collect usage patterns of natural language description of emotions among a community of speakers, a task which can be seen as a type of computational ethnography. We describe our target application, an emotionally-intelligent agent that can ask questions and learn about emotions through playing the emotion twenty questions (EMO20Q) game. We formalize the agentfs algorithms mathematically and algorithmically and test our model experimentally in an experiment of 45 human-computer dialogs with a range of emotional words as the independent variable. We found that (44%) of these dialog games are completed successfully, in comparison with earlier work in which human-human dialogs resulted in 85% successful completion on average. Despite lower than human performance, especially on difficult emotion words, the subjects rated that the agentfs humanity was 6.1 on a 0 to 10 scale. This indicates that the algorithm we present produces realistic behavior, but that issues of data sparsity may remain.

Index Terms: dialog agents, emotion recognition, chatbot, EMO20Q,

Full Paper

Bibliographic reference.  Kazemzadeh, Abe / Gibson, James / Li, Juanchen / Lee, Sungbok / Georgiou, Panayiotis G. / Narayanan, Shrikanth (2012): "A sequential Bayesian dialog agent for computational ethnography", In INTERSPEECH-2012, 238-241.