INTERSPEECH 2011 12th Annual Conference of the International Speech Communication Association Florence, Italy August 27-31. 2011

The KLAIR Toolkit for Recording Interactive Dialogues with a Virtual Infant

Mark Huckvale

University College London, UK

The goals of the KLAIR project are to facilitate research into the computational modelling of spoken language acquisition. Previously we have described the KLAIR toolkit that implements a virtual infant that can see, hear and talk. In this demonstration we show how the toolkit can be used to record interactive dialogues with caregivers. The outcomes are both an audio-video recording and a log of the "beliefs" and "goals" of the infant control program. These recordings can then be analysed by machine learning systems to model spoken language acquisition. In our demonstration, visitors will be able to interact with KLAIR and try to teach it the names of some toys.

Full Paper

Bibliographic reference.  Huckvale, Mark (2011): "The KLAIR toolkit for recording interactive dialogues with a virtual infant", In INTERSPEECH-2011, 3341-3342.