INTERSPEECH 2009
10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

Are Real Tongue Movements Easier to Speech Read than Synthesized?

Olov Engwall, Preben Wik

KTH, Sweden

Speech perception studies with augmented reality displays in talking heads have shown that tongue reading abilities are weak initially, but that subjects become able to extract some information from intra-oral visualizations after a short training session. In this study, we investigate how the nature of the tongue movements influences the results, by comparing synthetic rule-based and actual, measured movements. The subjects were significantly better at perceiving sentences accompanied by real movements, indicating that the current coarticulation model developed for facial movements is not optimal for the tongue.

Full Paper

Bibliographic reference.  Engwall, Olov / Wik, Preben (2009): "Are real tongue movements easier to speech read than synthesized?", In INTERSPEECH-2009, 824-827.