To investigate the nature of facial information involved in the integration of audiovisual speech perception, we examined the influence of facial views on the McGurk effect under two auditory conditions. While the speech perception of most of the audiovisual syllables used was little affected by the facial views and the auditory noise, a stronger McGurk effect was obtained for the 3/4-view image uttering labial sounds presented with auditory syllables of alveolars under the auditory noise. However, the facial view did not affect the visual identification of labials in the same way. These results suggest that the information about labial or nonlabial is not the only facial information involved in the McGurk effect. It appears some other information available only in the 3/4-view image might also be involved in the McGurk effect. Implications for the processing of visual, auditory and audiovisual speech are discussed.
Cite as: Kanzaki, R., Kato, T. (1998) Influence of facial views on the mcgurk effect in auditory noise. Proc. 5th International Conference on Spoken Language Processing (ICSLP 1998), paper 0243, doi: 10.21437/ICSLP.1998-265
@inproceedings{kanzaki98_icslp,
author={Rika Kanzaki and Takashi Kato},
title={{Influence of facial views on the mcgurk effect in auditory noise}},
year=1998,
booktitle={Proc. 5th International Conference on Spoken Language Processing (ICSLP 1998)},
pages={paper 0243},
doi={10.21437/ICSLP.1998-265}
}