Interspeech'2005 - Eurospeech

Lisbon, Portugal
September 4-8, 2005

The FASiL Speech and Multimodal Corpora

Hans Dolfing (1), David Reitter (2), Luís Almeida (3), Nuno Beires (3), Michael Cody (2), Rui Gomes (3), Kerry Robinson (1), Roman Zielinski (4)

(1) Vox Generation Ltd., UK; (2) MIT Media Lab Europe, Ireland; (3) Portugal Telecom Inovação, Portugal; (4) Capgemini Sweden

In the context of the FASiL project, we have studied natural language interactions in a unimodal (speech only) and multimodal (speech and graphics) interface to a personal information management database. We collected multilingual corpora to investigate these interactions in Portuguese, English and Swedish. The corpora are used to train language models, to update acoustic models, to study semantic concepts, multimodal interactions, and dialogue management strategies. The corpora are annotated in a uniform way, with timings, transcriptions, and semantics. We report on the structure and design of the corpora which are now available via ELRA.

Full Paper

Bibliographic reference.  Dolfing, Hans / Reitter, David / Almeida, Luís / Beires, Nuno / Cody, Michael / Gomes, Rui / Robinson, Kerry / Zielinski, Roman (2005): "The FASil speech and multimodal corpora", In INTERSPEECH-2005, 1605-1608.