12th Annual Conference of the International Speech Communication Association

Florence, Italy
August 27-31. 2011

Factored Translation Models for Improving a Speech into Sign Language Translation System

V. López-Ludeña, R. San-Segundo, R. Córdoba, J. Ferreiros, J. M. Montero, J. M. Pardo

Universidad Politécnica de Madrid, Spain

This paper proposes the use of Factored Translation Models (FTMs) for improving a Speech into Sign Language Translation System. These FTMs allow incorporating syntactic-semantic information during the translation process. This new information permits to reduce significantly the translation error rate. This paper also analyses different alternatives for dealing with the non-relevant words. The speech into sign language translation system has been developed and evaluated in a specific application domain: the renewal of Identity Documents and Driver's License. The translation system uses a phrase-based translation system (Moses). The evaluation results reveal that the BLEU (BiLingual Evaluation Understudy) has improved from 69.1% to 73.9% and the mSER (multiple references Sign Error Rate) has been reduced from 30.6% to 24.8%.

Full Paper

Bibliographic reference.  López-Ludeña, V. / San-Segundo, R. / Córdoba, R. / Ferreiros, J. / Montero, J. M. / Pardo, J. M. (2011): "Factored translation models for improving a speech into sign language translation system", In INTERSPEECH-2011, 1605-1608.