8th Annual Conference of the International Speech Communication Association

Antwerp, Belgium
August 27-31, 2007

Evaluation of Alternatives on Speech to Sign Language Translation

R. San-Segundo (1), A. Pérez (2), D. Ortiz (3), L. F. D'Haro (1), M. Inés Torres (2), F. Casacuberta (3)

(1) Universidad Politécnica de Madrid, Spain
(2) Universidad del País Vasco, Spain
(3) Universidad Politécnica de Valencia, Spain

This paper evaluates different approaches on speech to sign language machine translation. The framework of the application focuses on assisting deaf people to apply for the passport or related information. In this context, the main aim is to automatically translate the spontaneous speech, uttered by an officer, into Spanish Sign Language (SSL).

In order to get the best translation quality, three alternative techniques have been evaluated: a rule-based approach, a phrase-based statistical approach, and a approach that makes use of stochastic finite state transducers. The best speech translation experiments have reported a 32.0% SER (Sign Error Rate) and a 7.1 BLEU (BiLingual Evaluation Understudy) including speech recognition errors.

Full Paper

Bibliographic reference.  San-Segundo, R. / Pérez, A. / Ortiz, D. / D'Haro, L. F. / Torres, M. Inés / Casacuberta, F. (2007): "Evaluation of alternatives on speech to sign language translation", In INTERSPEECH-2007, 2529-2532.