Auditory-Visual Speech Processing 2005

British Columbia, Canada
July 24-27, 2005

Towards a Lexical Fuzzy Logical Model of Perception: The Time-Course of Audiovisual Speech Processing in Word Identification

Alexandra Jesse, Dominic W. Massaro

Perceptual Science Laboratory - University of California at Santa Cruz, CA, USA

This study investigates the time-course of information processing in both visual as well as in the auditory speech as used for word identification in face-to-face communication. It extends the limited previous research on this topic and provides a valuable database for future research in audiovisual speech perception. An evaluation of models of speech perception by ear and eye in their ability to account for the audiovisual gating data shows a superior role of the fuzzy logical model of perception (FLMP) [1] over additive models of perception. A new dynamic version of the FLMP seems to be a promising model to account for the complex interplay of perceptual and cognitive information in audiovisual spoken word recognition.

Full Paper

Bibliographic reference.  Jesse, Alexandra / Massaro, Dominic W. (2005): "Towards a lexical fuzzy logical model of perception: the time-course of audiovisual speech processing in word identification", In AVSP-2005, 35-36.