Auditory-Visual Speech Processing (AVSP) 2013

Annecy, France
August 29 - September 1, 2013

How Far Out? The Effect of Peripheral Visual Speech on Speech Perception

Jeesun Kim, Chris Davis

The MARCS Institute, University of Western Sydney, Australia

Seeing the talker’s moving face (visual speech) can facilitate or distort auditory speech perception. Our previous study showed that these effects occur even when visual speech was presented in the periphery and participants performed a central visual task. The current study examined the extent to which these effects were modulated by the eccentricity of visual speech: Visual speech presented at a visual angle of 10.40 (Exp 1) and 23.60 (Exp 2). In both experiments spoken /aba/ stimuli were presented in noise (-6 dB) with congruent or incongruent visual speech in full-face or upper-face (baseline) conditions. Other AV vCv syllables were also presented as filler items. Participants were to identify what they heard while performing a central visual task with their eyemovements monitored. Congruent visual speech facilitated speech perception; incongruent interfered. The sizes of the visual speech effects were smaller for the more eccentric presentation but were still significant. We discuss these results in terms of the form and timing cues that visual speech provides for incoming auditory speech and the robustness of the speech processes that use these cues.

Index Terms: Visual speech; Auditory-visual speech; Auditory-visual congruency; Visual periphery; Attention

Full Paper

Bibliographic reference.  Kim, Jeesun / Davis, Chris (2013): "How far out? the effect of peripheral visual speech on speech perception", In AVSP-2013, 123-128.