8th Annual Conference of the International Speech Communication Association

Antwerp, Belgium
August 27-31, 2007

Processing Image and Audio Information for Recognising Discourse Participation Status Through Features of Face and Voice

Nick Campbell (1), Damien Douxchamps (2)

(1) NICT, Japan
(2) NAIST, Japan

This paper describes a system based on a 360-degree camera with a single microphone that detects speech activity in a roundtable context for the purpose of estimating discourse participation status information for each member present. We have obtained 97% accuracy in detecting participants and have shown that the use of non-verbal and backchannel speech information is a useful indicator of participant status in a discourse.

Full Paper

Bibliographic reference.  Campbell, Nick / Douxchamps, Damien (2007): "Processing image and audio information for recognising discourse participation status through features of face and voice", In INTERSPEECH-2007, 730-733.