ISCA Archive Interspeech 2008
ISCA Archive Interspeech 2008

Feature adaptation of hearing-impaired lip shapes: the vowel case in the cued speech context

Noureddine Aboutabit, Denis Beautemps, Olivier Mathieu, Laurent Besacier

The phonetic translation of Cued Speech (CS) gestures needs to mix the manual CS information together with the lips, taking into account the desynchronization delay (Attina et al. [1], Aboutabit et al. [2]) between these two flows of information. This contribution focuses on the lip flow modeling in the case of French vowels. Previously, classification models have been developed for a professional normal-hearing CS speaker (Aboutabit et al., [3]). These models are used as a reference. In this study, we process the case of a deaf CS speaker and discuss the possibilities of classification. The best performance (92.8%) is obtained with the adaptation of the deaf data to the reference models.

s Attina, V., Beautemps, D., Cathiard, M. A. and Odisio, M. "A pilot study of temporal organization in cued speech production of French syllables: rules for Cued Speech synthesizer," Speech Communication, 44, pp. 197-214, 2004. Aboutabit, N., Beautemps, D. and Besacier, L., "Hand and Lips desynchronization analysis in French Cued Speech: Automatic segmentation of Hand flow". In Proc. of ICASSP, 2006. Aboutabit, N., Beautemps, D. and Besacier, L., "Vowels classification from lips: the Cued Speech production case". In Proceedings of ISSPÂ’06, 2006


doi: 10.21437/Interspeech.2008-694

Cite as: Aboutabit, N., Beautemps, D., Mathieu, O., Besacier, L. (2008) Feature adaptation of hearing-impaired lip shapes: the vowel case in the cued speech context. Proc. Interspeech 2008, 2843-2846, doi: 10.21437/Interspeech.2008-694

@inproceedings{aboutabit08_interspeech,
  author={Noureddine Aboutabit and Denis Beautemps and Olivier Mathieu and Laurent Besacier},
  title={{Feature adaptation of hearing-impaired lip shapes: the vowel case in the cued speech context}},
  year=2008,
  booktitle={Proc. Interspeech 2008},
  pages={2843--2846},
  doi={10.21437/Interspeech.2008-694}
}