11th Annual Conference of the International Speech Communication Association

Makuhari, Chiba, Japan
September 26-30. 2010

Improving the Readability of Class Lecture ASR Results Using a Confusion Network

Yasuhisa Fujii, Kazumasa Yamamoto, Seiichi Nakagawa

Toyohashi University of Technology, Japan

This paper presents a method for improving the readability of Automatic Speech Recognition (ASR) results for classroom lectures. Most of the previous research on improving the readability of recognition results focused mainly on manually transcribed texts, and not ASR results. Due to the presence of a large number of domain-dependent words and the casual presentation style, even state-of-the-art recognizers yield a 30-50% word error rate for speech in classroom lectures. Thus, a method for improving the readability of ASR results needs to be robust against recognition errors. In this paper, we propose a novel method for improving the readability based on a machine translation model that uses a confusion network representing multiple hypotheses of the ASR results to achieve robustness against recognition errors. Experimental results show that the proposed method outperforms the baselines in both automatic and manual evaluations.

Full Paper

Bibliographic reference.  Fujii, Yasuhisa / Yamamoto, Kazumasa / Nakagawa, Seiichi (2010): "Improving the readability of class lecture ASR results using a confusion network", In INTERSPEECH-2010, 3078-3081.