Auditory-Visual Speech Processing 2005

British Columbia, Canada
July 24-27, 2005

McGurk Fusion Effects in Arabic Words

Azra N. Ali (1), Ashraf Hassan-Haj (1), Michael Ingleby (1), Ali Idrissi (2)

(1) University of Huddersfield, UK; (2) Akhawayn University, Morocco

Our earlier work, on incongruent audiovisual segments embedded in English word- and phrase-stimuli, showed that McGurk fusion is sensitive to the phonological context of a segment. In this paper we describe the preparation and early testing of Arabic word stimuli with an incongruent phonetic segment. We confirm that in the context of Arabic words, fusion similar to that in English words still occurs, but is affected by differences in phonological contrasts between Arabic and English speech. In previous work on English, we have contrasted fusion in onset and coda sites at word-medial and word-edge positions. In Arabic this taxonomy of sites is rendered questionable by disagreements about syllabification and by the widespread occurrence of geminate consonants, which possibly behave as both coda and onset. We develop an improved site taxonomy, design a small lexicon of Arabic words that covers place and manner contrasts at all types of site, and outline some of the problems encountered when creating incongruent data for this lexicon. Finally, we report on fusion experiments using 10 participants that suggest there are no coda-onset distinctions in the mental models that mediate word perception amongst native Arabic speakers.

Full Paper

Bibliographic reference.  Ali, Azra N. / Hassan-Haj, Ashraf / Ingleby, Michael / Idrissi, Ali (2005): "McGurk fusion effects in Arabic words", In AVSP-2005, 11-16.