10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

Direct, Modular and Hybrid Audio to Visual Speech Conversion Methods - A Comparative Study

Gyorgy Takacs

Peter Pazmany University, Hungary

A systematic comparative study of audio to visual speech conversion methods is described in this paper. A direct conversion system is compared to conceptually different ASR based solutions. Hybrid versions of the different solutions will also be presented. The methods are tested using the same speech material, audio preprocessing and facial motion visualization units. Only the conversion blocks are changed. Subjective opinion score evaluation tests prove the naturalness of the direct conversion is the best.

Full Paper

Bibliographic reference.  Takacs, Gyorgy (2009): "Direct, modular and hybrid audio to visual speech conversion methods - a comparative study", In INTERSPEECH-2009, 2267-2270.