14thAnnual Conference of the International Speech Communication Association

Lyon, France
August 25-29, 2013

Analysis of Gaze and Speech Patterns in Three-Party Quiz Game Interaction

Samer Al Moubayed, Jens Edlund, Joakim Gustafson

KTH, Sweden

In order to understand and model the dynamics between interaction phenomena such as gaze and speech in face-to-face multiparty interaction between humans, we need large quantities of reliable, objective data of such interactions. To date, this type of data is in short supply. We present a data collection setup using automated, objective techniques in which we capture the gaze and speech patterns of triads deeply engaged in a high-stakes quiz game. The resulting corpus consists of five one-hour recordings, and is unique in that it makes use of three state-of-the-art gaze trackers (one per subject) in combination with a state-of-the-art conical microphone array designed to capture roundtable meetings. Several video channels are also included. In this paper we present the obstacles we encountered and the possibilities afforded by a synchronised, reliable combination of large-scale multi-party speech and gaze data, and an overview of the first analyses of the data.

Full Paper

Bibliographic reference.  Moubayed, Samer Al / Edlund, Jens / Gustafson, Joakim (2013): "Analysis of gaze and speech patterns in three-party quiz game interaction", In INTERSPEECH-2013, 1126-1130.