10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

Virtual Speech Reading Support for Hard of Hearing in a Domestic Multi-Media Setting

Samer Al Moubayed (1), Jonas Beskow (1), Ann-Marie Öster (1), Giampiero Salvi (1), Björn Granström (1), Nic van Son (2), Ellen Ormel (2)

(1) KTH, Sweden
(2) Viataal, The Netherlands

In this paper we present recent results on the development of the SynFace lip synchronized talking head towards multilinguality, varying signal conditions and noise robustness in the Hearing at Home project. We then describe the large scale hearing impaired user studies carried out for three languages. The user tests focus on measuring the gain in Speech Reception Threshold in Noise when using SynFace, and on measuring the effort scaling when using SynFace by hearing impaired people. Preliminary analysis of the results does not show significant gain in SRT or in effort scaling. But looking at inter-subject variability, it is clear that many subjects benefit from SynFace especially with speech with stereo babble noise.

Full Paper

Bibliographic reference.  Moubayed, Samer Al / Beskow, Jonas / Öster, Ann-Marie / Salvi, Giampiero / Granström, Björn / Son, Nic van / Ormel, Ellen (2009): "Virtual speech reading support for hard of hearing in a domestic multi-media setting", In INTERSPEECH-2009, 1443-1446.