The performance of isolated-word speech recognizers is typically measured using error rates. To obtain reliable error rate estimates for good recognizers can require many thousands of subject utterances, and, the better the recognizer, the more sensitive the error rate is to the actual challenge vocabulary and the skill of the talker. The Effective Vocabulary Capacity (EVC) is the maximum vocabulary that a recognizer can in principle handle at a given error rate. It relies on measures that are relatively independent of the challenge vocabulary and which require only tens or hundreds of test utterances. The EVC algorithm is tested for both synthetic and real recognizer data.
Cite as: Vegte, J.M.E.v.d., Taylor, M.M. (1989) Testing the effective vocabulary capacity method of evaluating speech recognizers. Proc. Speech Input/Output Assessment and Speech Databases, Vol.2, 135-138
@inproceedings{vegte89_sioa,
author={J. M. E. van de Vegte and M. M. Taylor},
title={{Testing the effective vocabulary capacity method of evaluating speech recognizers}},
year=1989,
booktitle={Proc. Speech Input/Output Assessment and Speech Databases},
pages={Vol.2, 135-138}
}