8th International Conference on Spoken Language Processing

Jeju Island, Korea
October 4-8, 2004

Neurocognition of Speech-Specific Audiovisual Perception

Mikko Sams, Ville Ojanen, Jyrki Tuomainen, Vasily Klucharev

Helsinki University of Technology, Finland

We have studied neurocognitive mechanisms of audiovisual perception of non-meaningful speech. We demonstrate different event-related brain potential (ERP) differences to non-speech and speech audiovisual stimuli. Our imaging studies show that viewing and listening to speech activate overlapping areas in the frontal cortex, which is also activated during speech production. We also demonstrate that subjects have to expect the auditory stimuli to be speech to integrate auditory and visual speech.

Full Paper

Bibliographic reference.  Sams, Mikko / Ojanen, Ville / Tuomainen, Jyrki / Klucharev, Vasily (2004): "Neurocognition of speech-specific audiovisual perception", In INTERSPEECH-2004, 2021-2024.