The paper presents the most recent enhancements of the standard methodologies for direct assessment of speech input systems which are developed and used within the European Community ESPRIT Project 6819 "Speech Technology Assessment in Multilingual Applications", SAM-A. The aim of the SAM-A project is to continue the development of methods, tools and databases to support performance assessment of speech input, output and speaker verification systems, based on the work performed in the now concluded well-known ESPRIT Project 2589, SAM. Focus in this paper is on the tools for direct assessment of speech input systems first developed in the SAM project, with an emphasis on the improvements already made and recognised improvements needed for execution of automated assessment of the more advanced recognisers, now being supported within SAM-A. Project participants have selected a number of speech recognition systems that will be employed as target recognisers in assessment experiments, which are briefly described in the paper as well.
Bibliographic reference. Danielsen, Sven W. (1993): "Enhanced direct assessment of speech input systems within the SAM-a esprit project", In EUROSPEECH'93, 207-210.