International Conference on Auditory-Visual Speech Processing 2008

Tangalooma Wild Dolphin Resort, Moreton Island, Queensland, Australia
September 26-29, 2008

Analysis of Technologies and Resources for Multimodal Information Kiosk for Deaf Users

Miloš Železný

Department of Cybernetics, Faculty of Applied Sciences, University of West Bohemia, Pilsen, Czech Republic

This paper presents an analysis of technologies and resources needed for building of a multimodal information kiosk for deaf people. The considered information kiosk will use sign language as main communication means, since it is main language of communication of deaf users. Thus, the sign language synthesis and recognition modules will be main part of the kiosk. Additional modules include lip-reading support for sign language recognition (since sign language is accompanied by lip articulation), touch screen input, and graphical user interface. To design and build the mentioned modules, large amounts of data are needed for training, especially in the case of recognition modules. The information kiosk is intended for use for provididng/ gathering information to/from deaf users, such us train connection or communication with authorities.

Full Paper

Bibliographic reference.  Železný, Miloš (2008): "Analysis of technologies and resources for multimodal information kiosk for deaf users", In AVSP-2008, 147-152.