Auditory-Visual Speech Processing 2007 (AVSP2007) Kasteel Groenendaal, Hilvarenbeek, The Netherlands August 31 - September 3, 2007

Analyzing and Modeling Gaze during Face-to-Face Interaction

Stephan Raidt, Gérard Bailly, Frédéric Elisei

Dept. of Speech & Cognition, GIPSA-Lab, Grenoble Universities, France

We present here the analysis of multimodal data gathered during realistic face-to-face interaction of a target speaker with a number of interlocutors. During several dyadic dialogs videos and gaze have been monitored with an original experimental setup using coupled cameras and screens equipped with eye tracking capabilities. For a detailed analysis of gaze patterns we distinguish different regions of interest on the face. With the aim to understand the functions of gaze in social interaction and to develop a coherent gaze control model for our talking heads we investigate the influence of cognitive state and social role on the observed gaze behaviour. Keywords: embodied conversational agents, face-to-face interaction, eye gaze, talking head, gaze model.

Full Paper

Bibliographic reference.  Raidt, Stephan / Bailly, Gérard / Elisei, Frédéric (2007): "Analyzing and modeling gaze during face-to-face interaction", In AVSP-2007, paper P23.