Auditory-Visual Speech Processing 2007 (AVSP2007)

Kasteel Groenendaal, Hilvarenbeek, The Netherlands
August 31 - September 3, 2007

Developmental Factor in Auditory-Visual Speech Perception - The McGurk Effect in Mandarin-Chinese and English Speakers

Yuchun Chen (1), Valerie Hazan (2)

(1) Department of Human Communication Science; (2) Department of Phonetics and Linguistics, University College London, UK

This study investigated the developmental factor in the use of visual information in auditory-visual speech perception in Mandarin-Chinese and English native speakers. Adults and 8- to 9-year-old children from two language backgrounds (Mandarin-Chinese and English) were presented stimuli consisting of /ba/, /da/, /ga/ and were asked to make syllable identifications in auditory-only, visual-only and auditory-visual (congruent and incongruent) conditions in clear and in noise. In order to test the second-language learning effect, an additional Chinese child group with a high degree of English exposure was also included. The results showed a developmental increase in the use of visual information and in the magnitude of McGurk effect in both Chinese and English groups. In addition, a positive correlation between the total visual effect and speechreading performance was found, suggesting that the smaller visual influence in the bimodal condition for children might be accounted for by their less sophisticated lip-reading ability. In regard with the foreign language effect, English listeners showed greater visual influence for tokens produced by Chinese speakers, but there was no difference linked to second-language exposure between the two Chinese child groups.

Full Paper

Bibliographic reference.  Chen, Yuchun / Hazan, Valerie (2007): "Developmental factor in auditory-visual speech perception - the Mcgurk effect in Mandarin-Chinese and English speakers", In AVSP-2007, paper P42.