Auditory-Visual Speech Processing (AVSP) 2011
The temporal synchrony of auditory and visual signals is known to affect the perception of audiovisual speech. Several papers have discussed the asymmetry of acoustic and visual timing cues. These results are usually based on subjective intelligibility tests and the reason is remained obscure. It is not clear that the observation is perception or production origin. In this paper the effect of audio-visual asynchrony is studied in an automatic bimodal speech recognition task, eliminating the perception expertise of observers. Results are utilized to improve naturalness of audiovisual speech synthesis.
Index Terms. speechreading, multimodality, audiovisual asymmetry
Video 1 (mpg) Video 2 (mpg) Video 3 (avi)
Bibliographic reference. Czap, László (2011): "On the audiovisual asynchrony of speech", In AVSP-2011, 137-140.