ISCA Archive ICSLP 2000
ISCA Archive ICSLP 2000

A framework for evaluating contextual understanding

Hélène Bonneau-Maynard, L. Devillers

In this paper we propose and describe a framework for evaluating and diagnosing the understanding component of a spoken dialog system which can be applied to both literal and contextual understanding. We have observed in a previous experiment that contextual understanding performance is strongly correlated to the user satisfaction. The framework uses a glassbox approach to diagnose the interpretation modules. Results are given on a 1681 literal understanding test set and 100 contextual understanding test set.


Cite as: Bonneau-Maynard, H., Devillers, L. (2000) A framework for evaluating contextual understanding. Proc. 6th International Conference on Spoken Language Processing (ICSLP 2000), vol. 3, 638-641

@inproceedings{bonneaumaynard00_icslp,
  author={Hélène Bonneau-Maynard and L. Devillers},
  title={{A framework for evaluating contextual understanding}},
  year=2000,
  booktitle={Proc. 6th International Conference on Spoken Language Processing (ICSLP 2000)},
  pages={vol. 3, 638-641}
}