Experimental Framework Design for Sign Language Automatic Recognition

Darío Tilves Santiago, Ian Benderitter, Carmen García-Mateo


Automatic sign language recognition (ASLR) is quite a complex task, not only for the intrinsic difficulty of automatic video information retrieval, but also because almost every sign language (SL) can be considered as an under-resourced language when it comes to language technology. Spanish sign language (SSL) is one of those under-resourced languages. Developing technology for SSL implies a number of technical challenges that must be tackled down in a structured and sequential manner. In this paper, the problem of how to design an experimental framework for machine-learning-based ASLR is addressed. In our review of existing datasets, our main conclusion is that there is a need for high-quality data. We therefore propose some guidelines on how to conduct the acquisition and annotation of an SSL dataset. These guidelines were developed after conducting some preliminary ASLR experiments with small and limited subsets of existing datasets.


 DOI: 10.21437/IberSPEECH.2018-16

Cite as: Tilves Santiago, D., Benderitter, I., García-Mateo, C. (2018) Experimental Framework Design for Sign Language Automatic Recognition. Proc. IberSPEECH 2018, 72-76, DOI: 10.21437/IberSPEECH.2018-16.


@inproceedings{Tilves Santiago2018,
  author={Darío {Tilves Santiago} and Ian Benderitter and Carmen García-Mateo},
  title={{Experimental Framework Design for Sign Language Automatic Recognition}},
  year=2018,
  booktitle={Proc. IberSPEECH 2018},
  pages={72--76},
  doi={10.21437/IberSPEECH.2018-16},
  url={http://dx.doi.org/10.21437/IberSPEECH.2018-16}
}