Third Workshop on Child, Computer and Interaction (WOCCI 2012)

Portland, OR, USA
September 14, 2012

Spoken Language Processing in a Conversational System for Child-Robot Interaction

Ivana Kruijff-Korbayová (1), Heriberto Cuay'ahuitl (1), Bernd Kiefer (1), Marc Schröder (1), Piero Cosi (2), Giulio Paci (2), Giacomo Sommavilla (2), Fabio Tesser (2), Hichem Sahli (3), Georgios Athanasopoulos (3), Weiyi Wang (3), Valentin Enescu (3), Werner Verhelst (3)

(1) DFKI GmbH, Language Technology Lab, Saarbrücken, Germany
(2) Istituto di Scienze e Tecnologie della Cognizione, ISTC, C.N.R., Italy
(3) Interdisciplinary Institute for Broadband Technology - IBBT, Vrije Universiteit Brussel, Dept. of Electronics and Informatics, Belgium

We describe a conversational system for child-robot interaction built with an event-based integration approach using the Nao robot platform with the Urbi middleware within the ALIZE project. Our integrated system includes components for the recognition, interpretation and generation of speech and gestures, dialogue management and user modeling. We describe our approach to processing spoken input and output and highlight some practical implementation issues. We also present preliminary results from experiments where young Italian users interacted with the system.

Index Terms: human-robot interaction, integration, Nao, Urbi, italian children speech recognition, italian speech synthesis, voice activity detection, sound source localization, dialogue management, natural language generation, non-verbal behavior generation.

Full Paper

Bibliographic reference.  Kruijff-Korbayová, Ivana / Cuay'ahuitl, Heriberto / Kiefer, Bernd / Schröder, Marc / Cosi, Piero / Paci, Giulio / Sommavilla, Giacomo / Tesser, Fabio / Sahli, Hichem / Athanasopoulos, Georgios / Wang, Weiyi / Enescu, Valentin / Verhelst, Werner (2012): "Spoken language processing in a conversational system for child-robot interaction", In WOCCI-2012, 32-39.