11th Annual Conference of the International Speech Communication Association

Makuhari, Chiba, Japan
September 26-30. 2010

Turn-Alignment Using Eye-Gaze and Speech in Conversational Interaction

Kristiina Jokinen (1), Kazuaki Harada (2), Masafumi Nishida (2), Seiichi Yamamoto (2)

(1) University of Helsinki, Finland
(2) Doshisha University, Japan

Spoken interactions are known for accurate timing and alignment between interlocutors: turn-taking and topic flow are managed in a manner that provides conversational fluency and smooth progress of the task. This paper studies the relation between the interlocutors’ eye-gaze and spoken utterances, and describes our experiments on turn alignment. We conducted classification experiments by Support Vector Machine on turn-taking using the features for dialogue act, eye-gaze, and speech prosody in conversation data. As a result, we demonstrated that eye-gaze features are important signals in turn management, and seem even more important than speech features when the intention of utterances is clear.

Full Paper

Bibliographic reference.  Jokinen, Kristiina / Harada, Kazuaki / Nishida, Masafumi / Yamamoto, Seiichi (2010): "Turn-alignment using eye-gaze and speech in conversational interaction", In INTERSPEECH-2010, 2018-2021.