1st Joint SIG-IL/Microsoft Workshop on Speech and Language Technologies for Iberian Languages

Porto Salvo, Portugal
September 3-4, 2009

SD-TEAM: Interactive Learning, Self-Evaluation and Multimodal Technologies for Multidomain Spoken Dialog Systems

María Inés Torres (1), Eduardo Lleida (2), Emilio Sanchis (3), Ricardo de Córdoba (4), Javier Macías-Guarasa (5)

(1) Pattern Recognitiona & Speech Technologies Group. University of the Basque Country. Spain
(2) Communication Technologies Group. University of Zaragoza, Spain
(3) Pattern Recognition and Artifitial Intelligence Group. Polytechnic University of Valencia, Sp
(4) Speech Technology Group. Polytechnic University of Madrid, Spain
(4) Speech Technology Group. Polytechnic University of Madrid, Spain
(5) Intelligent spaces and Transport Group. University of Alcalá de Henares, Spain

Speech technology currently supports the development of dialogue systems that function in limited domains for which they were trained and in conditions for which they were designed, that is, specific acoustic conditions, speakers etc. The international scientific community has made significant efforts in exploring methods for adaptation to different acoustic contexts, tasks and types of user. However, further work is needed to produce multimodal spoken dialogue systems capable of exploiting interactivity to learn online in order to improve their performance.
   The goal is to produce flexible and dynamic multimodal, interactive systems based on spoken communication, capable of detecting automatically their operating conditions and especially of learning from user interactions and experience through evaluating their own performance. Such ?living? systems will evolve continuously and without supervision until user satisfaction is achieved. Special attention will be paid to those groups of users for which adaptation and personalisation is essential: amongst others, people with disabilities which lead to communication difficulties (hearing loss, dysfluent speech, ...), mobility problems and non-native users.
   In this context, the SD-TEAM Project aims to advance the development of technologies for interactive learning and evaluation. In addition, it will develop flexible distributed architectures that allow synergistic interaction between processing modules from a variety of dialogue systems designed for distinct tasks, user groups, acoustic conditions, etc. These technologies will be demonstrated via multimodal dialogue systems to access to services from home and to access to unstructured information, based on the multi-domain systems developed in the previous project TIN2005-08660-C04.

Full Paper

Bibliographic reference.  Torres, María Inés / Lleida, Eduardo / Sanchis, Emilio / Córdoba, Ricardo de / Macías-Guarasa, Javier (2009): "SD-TEAM: interactive learning, self-evaluation and multimodal technologies for multidomain spoken dialog systems", In SLTECH-2009, 127-130.