Interspeech'2005 - Eurospeech

Lisbon, Portugal
September 4-8, 2005

Synchronizing Dialogue Contributions of Human Users and Virtual Characters in a Virtual Reality Environment

Norbert Pfleger, Markus Löckelt

DFKI GmbH, Saarbrücken, Germany

Synchronizing user and system actions in a real-time virtual reality environment is a challenging task. Key components of a dialogue system like speech recognition, discourse processing, speech generation and synthesis all contribute significant delays to the response time. With human interlocutors, however, a continuous flow of conversation is important as any implausible gap may cause confusion with respect to floor management. In this paper, we describe some cases of how to make sensible use of information available at each processing step to be able to give early useful feedback even while processing.

Full Paper

Bibliographic reference.  Pfleger, Norbert / Löckelt, Markus (2005): "Synchronizing dialogue contributions of human users and virtual characters in a virtual reality environment", In INTERSPEECH-2005, 2773-2776.