11th Annual Conference of the International Speech Communication Association

Makuhari, Chiba, Japan
September 26-30. 2010

Advanced Speech Communication System for Deaf People

Rubén San-Segundo, Verónica López, Raquel Martín, Syaheerah Lufti, Javier Ferreiros, Ricardo Córdoba, José Manuel Pardo

Universidad Politécnica de Madrid, Spain

This paper describes the development and field evaluation of an Advanced Speech Communication System for Deaf People. The system has two modules. The first one is a Spanish into Spanish Sign Language (LSE: Lengua de Signos Espańola) translation module made up of a speech recognizer, a natural language translator (for converting a word sequence into a sequence of signs), and a 3D avatar animation module (for playing back the signs). The second module is a Spoken Spanish generator from sign-writing composed of a visual interface (for specifying a sign sequence), a language translator (for generating a Spanish sentence), and finally, a text to speech converter. The system integrates three translation technologies: an example-based strategy, a rule-based translation method and a statistical translator. The field evaluation was carried out in the Local Traffic Office in the city of Toledo (Spain) involving real government employees and deaf people.

Full Paper

Bibliographic reference.  San-Segundo, Rubén / López, Verónica / Martín, Raquel / Lufti, Syaheerah / Ferreiros, Javier / Córdoba, Ricardo / Pardo, José Manuel (2010): "Advanced speech communication system for deaf people", In INTERSPEECH-2010, 250-253.