Interspeech'2005 - Eurospeech Lisbon, Portugal September 4-8, 2005

From Question Answering to Spoken Dialogue: Towards an Information Search Assistant for Interactive Multimodal Information Extraction

Rieks op den Akker (1), Harry Bunt (2), Simon Keizer (2), Boris van Schooten (1)

(1) Universiteit Twente, The Netherlands; (2) Tilburg University, The Netherlands

This paper gives an overview of issues related to extending simple question answering (QA) with dialogue capabilities, when designing a multimodal interactive information extraction system for a large, though restricted, domain.

We present the way in which these issues are approached in the IMIX program. The IMIX demonstrator system, under development in this program, may be considered the most difficult case of QA, answering non-factoid questions in a large domain, and accepting speech input as well. We describe our approach to the addition of dialogue capabilities to this system.

We will look at QA from a dialogue system perspective and from a HCI perspective, and consider the consequences of our choice of interaction metaphor, the ‘information search assistant'.

Full Paper

Bibliographic reference.  Akker, Rieks op den / Bunt, Harry / Keizer, Simon / Schooten, Boris van (2005): "From question answering to spoken dialogue: towards an information search assistant for interactive multimodal information extraction", In INTERSPEECH-2005, 2793-2796.