Interspeech'2005 - Eurospeech

Lisbon, Portugal
September 4-8, 2005

Interactions Between Speech Recognition Problems and User Emotions

Mihai Rotaru, Diane J. Litman, Katherine Forbes-Riley

University of Pittsburgh, USA

Understanding how speech recognition problems affect the interaction with the user is a topic of great interest for the spoken dialogue community. In this paper, we examine the dependencies between speech recognition problems in adjacent turns. We also examine the dependencies between speech recognition problems and student emotions within a turn and in adjacent turns. We apply Chi Square (χ2) analysis to a corpus of speech-based computer tutoring dialogues to discover these dependencies. We find that rejections are followed by more rejections than expected if there was no dependency between rejections, and that misrecognitions are followed by more misrecognitions than expected. We also find a strong dependency between recognition problems in the previous turn and user emotion in the current turn: after a system rejection there are more emotional user turns than expected. Surprisingly, in our data, we find no relationship between user emotions and recognition problems within a turn nor between previous turn user emotions and current turn recognition problems.

Full Paper

Bibliographic reference.  Rotaru, Mihai / Litman, Diane J. / Forbes-Riley, Katherine (2005): "Interactions between speech recognition problems and user emotions", In INTERSPEECH-2005, 2481-2484.