5th International Conference on Spoken Language Processing

Sydney, Australia
November 30 - December 4, 1998

Influence of Facial Views on the McGurk Effect in Auditory Noise

Rika Kanzaki (1), Takashi Kato (2)

(1) ATR Human Information Processing Research Laboratories, Japan
(2) Kansai University, Japan

To investigate the nature of facial information involved in the integration of audiovisual speech perception, we examined the influence of facial views on the McGurk effect under two auditory conditions. While the speech perception of most of the audiovisual syllables used was little affected by the facial views and the auditory noise, a stronger McGurk effect was obtained for the 3/4-view image uttering labial sounds presented with auditory syllables of alveolars under the auditory noise. However, the facial view did not affect the visual identification of labials in the same way. These results suggest that the information about labial or nonlabial is not the only facial information involved in the McGurk effect. It appears some other information available only in the 3/4-view image might also be involved in the McGurk effect. Implications for the processing of visual, auditory and audiovisual speech are discussed.

Full Paper

Bibliographic reference.  Kanzaki, Rika / Kato, Takashi (1998): "Influence of facial views on the mcgurk effect in auditory noise", In ICSLP-1998, paper 0243.