This paper describes the first experiments of a speech to sign language translation system in a real domain. The developed system is focused on the sentences spoken by an officer when assisting people in applying for, or renewing the National Identification Document (NID) and the Passport. This system translates officer explanations into sign language for deaf-mute people. The translation system is composed by a speech recognizer (for decoding the spoken utterance into a word sequence), a natural language translator (for converting a word sequence into a sequence of gestures belonging to the sign language), and a 3D avatar animation module (for playing the gestures). The field experiments have reported a 27.2% GER (Gesture Error Rate) and a 0.62 BLEU (BiLingual Evaluation Understudy).
Cite as: San-Segundo, R., Barra, R., D’Haro, L.F., Montero, J.M., Córdoba, R., Ferreiros, J. (2006) A Spanish speech to sign language translation system for assisting deaf-mute people. Proc. Interspeech 2006, paper 1243-Tue3CaP.12, doi: 10.21437/Interspeech.2006-420
@inproceedings{sansegundo06_interspeech,
author={R. San-Segundo and R. Barra and L. F. D’Haro and J. M. Montero and R. Córdoba and J. Ferreiros},
title={{A Spanish speech to sign language translation system for assisting deaf-mute people}},
year=2006,
booktitle={Proc. Interspeech 2006},
pages={paper 1243-Tue3CaP.12},
doi={10.21437/Interspeech.2006-420}
}