ISCA Archive Interspeech 2009
ISCA Archive Interspeech 2009

Virtual speech reading support for hard of hearing in a domestic multi-media setting

Samer Al Moubayed, Jonas Beskow, Ann-Marie Öster, Giampiero Salvi, Björn Granström, Nic van Son, Ellen Ormel

In this paper we present recent results on the development of the SynFace lip synchronized talking head towards multilinguality, varying signal conditions and noise robustness in the Hearing at Home project. We then describe the large scale hearing impaired user studies carried out for three languages. The user tests focus on measuring the gain in Speech Reception Threshold in Noise when using SynFace, and on measuring the effort scaling when using SynFace by hearing impaired people. Preliminary analysis of the results does not show significant gain in SRT or in effort scaling. But looking at inter-subject variability, it is clear that many subjects benefit from SynFace especially with speech with stereo babble noise.


doi: 10.21437/Interspeech.2009-442

Cite as: Moubayed, S.A., Beskow, J., Öster, A.-M., Salvi, G., Granström, B., Son, N.v., Ormel, E. (2009) Virtual speech reading support for hard of hearing in a domestic multi-media setting. Proc. Interspeech 2009, 1443-1446, doi: 10.21437/Interspeech.2009-442

@inproceedings{moubayed09_interspeech,
  author={Samer Al Moubayed and Jonas Beskow and Ann-Marie Öster and Giampiero Salvi and Björn Granström and Nic van Son and Ellen Ormel},
  title={{Virtual speech reading support for hard of hearing in a domestic multi-media setting}},
  year=2009,
  booktitle={Proc. Interspeech 2009},
  pages={1443--1446},
  doi={10.21437/Interspeech.2009-442}
}