7th International Conference on Spoken Language Processing

September 16-20, 2002
Denver, Colorado, USA

The Stimulus as Basis for Audiovisual Integration

Eric Vatikiotis-Bateson (1), Harold Hill (1), Miyuki Kamachi (1), Karen Lander (2), Kevin G. Munhall (3)

(1) ATR Human Information Science Laboratories, Japan; (2) Manchester University, U.K.; (3) Queen’s University, Canada

We argue here that examination of the stimulus source is a prerequisite to understanding how audiovisual (AV) stimuli are processed perceptually. This is based on mounting evidence that the act of speech production generates multimodal events whose audible and visible components are highly correlated with each other and the vocal tract source. How this multimodal structuring is exploited perceptually, or not, needs to be demonstrated by conducting studies that take the properties of the stimulus source into account.

Full Paper

Bibliographic reference.  Vatikiotis-Bateson, Eric / Hill, Harold / Kamachi, Miyuki / Lander, Karen / Munhall, Kevin G. (2002): "The stimulus as basis for audiovisual integration", In ICSLP-2002, 1457-1460.