Auditory-Visual Speech Processing (AVSP'99) August 7-10, 1999 Santa Cruz, CA, USA

Feature Based Representation for Audio-Visual Speech Recognition

Partha Niyogi, Eric Petajan, Jialin Zhong

Bell Labs - Lucent Technologies, Murray Hill, NJ, USA

In this paper, we consider the integration of acoustic and visual stimuli at the subphonemic level of the distinctive feature. We argue that this provides a natural intermediate level for audio-visual integration and discuss the visual and acoustic feature detection problems that are associated with this task.

Full Paper

Bibliographic reference.  Niyogi, Partha / Petajan, Eric / Zhong, Jialin (1999): "Feature based representation for audio-visual speech recognition", In AVSP-1999, paper #16.