Auditory-Visual Speech Processing
(AVSP 2001)

September 7-9, 2001
Aalborg, Denmark

Investigating the Role of Luminance Boundaries in Visual and Audiovisual Speech Recognition Using Line Drawn Faces

M. V. McCotter, T.R. Jordan

School of Psychology; University of Nottingham, UK

Two experiments are reported which investigate the contribution of luminance boundaries to visual and audiovisual speech perception using colour, grey scale and line drawn talking faces. Use of line drawn faces should isolate basic luminance boundaries, while removing the distribution of luminance from the face. Unimodal auditory and visual syllables were combined to produce congruent (matching) and incongruent (McGurk) speech stimuli. Visual speech presented in line drawn faces was highly recognisable and influenced perception of congruent and incongruent auditory speech. However, visual speech presented in colour and grey scale faces was slightly more accurate and influential on perception of auditory speech perception than visual speech presented in line drawn faces. In light of these findings, the role of luminance boundaries in perception of visual and audiovisual speech is discussed.


Full Paper

Bibliographic reference.  McCotter, M.V. / Jordan, T.R. (2001): "Investigating the role of luminance boundaries in visual and audiovisual speech recognition using line drawn faces", In AVSP-2001, 143-148.

Multimedia File

Link Original Filename Description Format
av01_143_1.mov (19761 KB) avspcdrom1.MOV The examples show examples from two experiments on the contribution of luminance boundaries to visual and audiovisual speech perception using colour, grey scale and line drawn talking faces Video File - Quicktime