10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

An Audio-Visual Approach to Measuring Discourse Synchrony in Multimodal Conversation Data

Nick Campbell

Trinity College Dublin, Ireland

This paper describes recent work on the automatic extraction of visual and audio parameters relating to the detection of synchrony in discourse, and to the modelling of active listening for advanced speech technology. It reports findings based on image processing that reliably identify the strong entrainment between members of a group conversation, and describes techniques for the extraction and analysis of such information.

Full Paper

Bibliographic reference.  Campbell, Nick (2009): "An audio-visual approach to measuring discourse synchrony in multimodal conversation data", In INTERSPEECH-2009, 2159-2162.