Auditory-Visual Speech Processing
Two experiments are reported which investigate the contribution of luminance boundaries to visual and audiovisual speech perception using colour, grey scale and line drawn talking faces. Use of line drawn faces should isolate basic luminance boundaries, while removing the distribution of luminance from the face. Unimodal auditory and visual syllables were combined to produce congruent (matching) and incongruent (McGurk) speech stimuli. Visual speech presented in line drawn faces was highly recognisable and influenced perception of congruent and incongruent auditory speech. However, visual speech presented in colour and grey scale faces was slightly more accurate and influential on perception of auditory speech perception than visual speech presented in line drawn faces. In light of these findings, the role of luminance boundaries in perception of visual and audiovisual speech is discussed.
Bibliographic reference. McCotter, M.V. / Jordan, T.R. (2001): "Investigating the role of luminance boundaries in visual and audiovisual speech recognition using line drawn faces", In AVSP-2001, 143-148.
|av01_143_1.mov (19761 KB)||avspcdrom1.MOV||The examples show examples from two experiments on the contribution of luminance boundaries to visual and audiovisual speech perception using colour, grey scale and line drawn talking faces||Video File - Quicktime|