ISCA Archive ICSLP 1994
ISCA Archive ICSLP 1994

Listener eye movement behavior during audiovisual speech perception

Eric Vatikiotis-Bateson, Inge-Marie Eigsti, Sumio Yano

Results are presented for two experiments in which listener eye movements were recorded during video presentations of extended monologues. Monologues were presented with various levels of acoustic masking noise. The first experiment verified that the presence of visual stimuli enhanced intelligibility of the audiovisual stimuli. The second experiment showed a clear tendency for listeners of both Japanese and English to move their eyes less as perceptual difficulty increased, even when the image size of the stimuli was many times larger than life-size. Furthermore, preliminary results are discussed concerning the role of the eyes and mouth as targets for visual cues to speech communication, and an hypothesis for audiovisual enhancement of perception is discussed that integrates auditory localization and tracking of visual cues to speech.


Cite as: Vatikiotis-Bateson, E., Eigsti, I.-M., Yano, S. (1994) Listener eye movement behavior during audiovisual speech perception. Proc. 3rd International Conference on Spoken Language Processing (ICSLP 1994), 527-530

@inproceedings{vatikiotisbateson94_icslp,
  author={Eric Vatikiotis-Bateson and Inge-Marie Eigsti and Sumio Yano},
  title={{Listener eye movement behavior during audiovisual speech perception}},
  year=1994,
  booktitle={Proc. 3rd International Conference on Spoken Language Processing (ICSLP 1994)},
  pages={527--530}
}