AVSP 2003 - International Conference on Audio-Visual Speech Processing

September 4-7, 2003
St. Jorioz, France

Effect of Audiovisual Primes on Identification of Auditory Target Syllables

Ville Ojanen, Jyrki Tuomainen, Mikko Sams

Laboratory of Computational Engineering, Helsinki University of Technology, Finland

We studied the representations underlying audiovisual integration using a priming paradigm. Audiovisual primes, preceding auditory targets, were either incongruent (auditory /ba/ & visual /va/) or congruent (auditory /va/ & visual /va/, auditory /ba/ & visual /ba/). The targets were /ba/ or /va/. The intensity of the prime´s auditory component was either 50 dB or 60 dB. Identification speed of the target /ba/ was strongly affected by the nature of the prime. The effect of the incongruent audiovisual prime depended on the intensity of its acoustic component. Our results suggest that processing of visible articulatory movements influence auditory speech processing.

Full Paper

Bibliographic reference.  Ojanen, Ville / Tuomainen, Jyrki / Sams, Mikko (2003): "Effect of audiovisual primes on identification of auditory target syllables", In AVSP 2003, 71-75.