Accessing Information in Spoken Audio

April 19-20, 1999
Cambridge, UK

Spoken Document Retrieval: 1998 Evaluation and Investigation of New Metrics

John S. Garofolo, Ellen M. Voorhees, Cedric G. P. Auzanne, Vincent M. Stanford

Information Technology Laboratory, National Institute of Standards and Technology (NIST) Gaithersburg, MD, USA

This paper describes the 1998 TREC-7 Spoken Document Retrieval (SDR) Track which implemented an evaluation of retrieval of broadcast news excerpts using a combination of automatic speech recognition and information retrieval technologies. The motivations behind the SDR Track and background regarding its development and implementation are discussed. The SDR evaluation collection and topics are described and summaries and analyses of the results of the track are presented. Alternative metrics for automatic speech recognition as applicable to retrieval applications are also explored. Finally, plans for future SDR tracks are described.


Full Paper (PDF)   Full Paper (Zipped Postscript)

Bibliographic reference.  Garofolo, John S. / Voorhees, Ellen M. / Auzanne, Cedric G. P. / Stanford, Vincent M. (1999): "Spoken Document Retrieval: 1998 evaluation and investigation of new metrics", In Access-Audio-1999, 1-7.