The paper describes a new evaluation measure for speech recognition in spoken language dialogue systems. The measure is based on the usefulness of the recognition for the system, and the usefulness is measured at the level of meaning representation. It is argued that the new measure is more useful than word error rate, and is more accurate than simpler functional measures.
Cite as: Hutchinson, B. (2001) A functional approach to speech recognition evaluation. Proc. 7th European Conference on Speech Communication and Technology (Eurospeech 2001), 1683-1686, doi: 10.21437/Eurospeech.2001-394
@inproceedings{hutchinson01_eurospeech,
author={Ben Hutchinson},
title={{A functional approach to speech recognition evaluation}},
year=2001,
booktitle={Proc. 7th European Conference on Speech Communication and Technology (Eurospeech 2001)},
pages={1683--1686},
doi={10.21437/Eurospeech.2001-394}
}