9th Annual Conference of the International Speech Communication Association

Brisbane, Australia
September 22-26, 2008

An Analysis of Multimodal Cues of Interruption in Dyadic Spoken Interactions

Chi-Chun Lee, Sungbok Lee, Shrikanth S. Narayanan

University of Southern California, USA

Interruptions are integral elements of natural spontaneous human interaction. Both competitive and cooperative interruption serve a distinct role in the flow of conversation. This paper analyzes their differences with features, change and activeness, employing audio, visual, and disfluency data. These features are able to capture differences between the two types of interruptions better than average feature values of any single modality. Also, discriminant analysis shows that the use of multimodal cues provides a 21% improvement in classification accuracy between the two types of interruptions relative to the baseline while any individual single modality cue does not provide significant improvement.

Full Paper

Bibliographic reference.  Lee, Chi-Chun / Lee, Sungbok / Narayanan, Shrikanth S. (2008): "An analysis of multimodal cues of interruption in dyadic spoken interactions", In INTERSPEECH-2008, 1678-1681.