Auditory-Visual Speech Processing 2007 (AVSP2007) Kasteel Groenendaal, Hilvarenbeek, The Netherlands August 31 - September 3, 2007

Effect of Native Language Experience on Audio-visual Perception of English Fricatives by Korean and Mandarin Natives

Yue Wang (1), Dawn Behne (2), Haisheng Jiang (1), Angela Feehan (1)

(1) Department of Linguistics, Simon Fraser University, Canada
(2) Department of Psychology, Norwegian University of Science and Technology, Norway

This study examines how native language (L1) experience affects audio-visual (AV) perception of nonnative (L2) speech. Mandarin, Korean, and English perceivers were presented English CV syllables containing fricatives with 3 places of articulation: labiodentals nonexistent in Korean, interdentals nonexistent in Korean and Mandarin, and alveolars occurring in all L1s. The stimuli were presented as: audio-only (A), visual-only (V), congruent AV, and incongruent AV. Results show that all groups performed better in the AV than A or V condition. The English perceivers outperformed the nonnatives. Mandarin perceivers relied more on V input, and greater AV integration with incongruent AV, whereas Koreans benefited more from A. These findings indicate that nonnatives had less effective AV integration than natives with sounds involving visually unfamiliar places of articulation. The nonnatives’ AV processing was differentially influenced by L1 experience. Conversely, similarities across groups indicate possible perceptual universals. Together they point to an integrated network in speech processing across modalities and linguistic backgrounds.

Full Paper

Bibliographic reference.  Wang, Yue / Behne, Dawn / Jiang, Haisheng / Feehan, Angela (2007): "Effect of native language experience on audio-visual perception of English fricatives by Korean and Mandarin natives", In AVSP-2007, paper P35.