In spoken dialog systems it is often the case that the sentence produced by the decoder with the highest recognition probability may not be the best choice for extracting the intended concepts. Lower ranking hypotheses may present better alternatives. In this paper, we show how to integrate multiple knowledge sources for the decision of selecting one of these hypotheses. A scoring schema combining information from the recognizer output, the parser, an utterance type classifier and dialog context is used. The scaling weights of the combined scores are determined automatically by an optimization procedure. Finally, we show the results of testing this approach and its performance compared to the approach of selecting the best recognition hypothesis.
Cite as: Abdou, S., Scordilis, M. (2001) Integrating multiple knowledge sources for improved speech understanding. Proc. 7th European Conference on Speech Communication and Technology (Eurospeech 2001), 1783-1786, doi: 10.21437/Eurospeech.2001-421
@inproceedings{abdou01_eurospeech,
author={Sherif Abdou and Michael Scordilis},
title={{Integrating multiple knowledge sources for improved speech understanding}},
year=2001,
booktitle={Proc. 7th European Conference on Speech Communication and Technology (Eurospeech 2001)},
pages={1783--1786},
doi={10.21437/Eurospeech.2001-421}
}