4th International Conference on Spoken Language Processing

Philadelphia, PA, USA
October 3-6, 1996

Evaluation of Spoken Language Understanding and Dialogue Systems

Bernd Hildebrandt (1), Heike Rautenstrauch (2), Gerhard Sagerer (1)

(1) Universitšt Bielefeld, AG Angewandte Informatik, Bielefeld, Germany
(2) SAP-AG, Walldorf, Germany

A spoken language understanding and dialogue system in the domain of appointment schedule is presented. The system is capable of understanding complex times, e.g. it correctly combines discontinuous constituents and resolves ambiguities. A distributed representation of surface structure models and an incremental semantic analysis is used to manage the complexity. An elaborate evaluation of the system based on measurements of accuracy was carried out. Our approach combines pattern recognition with linguistic aspects forming a system of measurement consisting of word accuracy, constituent accuracy, and concept accuracy.

Full Paper

Bibliographic reference.  Hildebrandt, Bernd / Rautenstrauch, Heike / Sagerer, Gerhard (1996): "Evaluation of spoken language understanding and dialogue systems", In ICSLP-1996, 685-688.