In this paper, we describe our efforts in designing and building a prototype multimodal system for children users. Data collection efforts and user experience results from a WoZ study using a popular computer game are reviewed first. Automatic speech recognition and spoken language understanding technology for children speakers are discussed next. A multimodal prototype is designed for a personal agent and a gaming application. Emphasis is placed on a modular architecture, handling of multimodal input and multimedia output, and providing an engaging user interface. Informal evaluation by children users was very positive especially for the animated agent and the speech interface.
Cite as: Narayanan, S., Potamianos, A., Wang, H. (1999) Multimodal systems for children: building a prototype. Proc. 6th European Conference on Speech Communication and Technology (Eurospeech 1999), 1727-1730, doi: 10.21437/Eurospeech.1999-388
@inproceedings{narayanan99_eurospeech,
author={Shrikanth Narayanan and Alexandros Potamianos and Haohong Wang},
title={{Multimodal systems for children: building a prototype}},
year=1999,
booktitle={Proc. 6th European Conference on Speech Communication and Technology (Eurospeech 1999)},
pages={1727--1730},
doi={10.21437/Eurospeech.1999-388}
}