Sixth European Conference on Speech Communication and Technology

Budapest, Hungary
September 5-9, 1999

Multimodal Systems for Children: Building a Prototype

Shrikanth Narayanan, Alexandros Potamianos, Haohong Wang

AT&T Labs-Research, Florham Park, NJ, USA

In this paper, we describe our efforts in designing and building a prototype multimodal system for children users. Data collection efforts and user experience results from a WoZ study using a popular computer game are reviewed first. Automatic speech recognition and spoken language understanding technology for children speakers are discussed next. A multimodal prototype is designed for a personal agent and a gaming application. Emphasis is placed on a modular architecture, handling of multimodal input and multimedia output, and providing an engaging user interface. Informal evaluation by children users was very positive especially for the animated agent and the speech interface.

Full Paper (PDF)   Gnu-Zipped Postscript

Bibliographic reference.  Narayanan, Shrikanth / Potamianos, Alexandros / Wang, Haohong (1999): "Multimodal systems for children: building a prototype", In EUROSPEECH'99, 1727-1730.