8th Annual Conference of the International Speech Communication Association

Antwerp, Belgium
August 27-31, 2007

Dynamic Language Model Adaptation Using Presentation Slides for Lecture Speech Recognition

Hiroki Yamazaki, Koji Iwano, Koichi Shinoda, Sadaoki Furui, Haruo Yokota

Tokyo Institute of Technology, Japan

We propose a dynamic language model adaptation method that uses the temporal information from lecture slides for lecture speech recognition. The proposed method consists of two steps. First, the language model is adapted with the text information extracted from all the slides of a given lecture. Next, the text information of a given slide is extracted based on temporal information and used for local adaptation. Hence, the language model, used to recognize speech associated with the given slide changes dynamically from one slide to the next. We evaluated the proposed method with the speech data from four Japanese lecture courses. Our experiments show the effectiveness of our proposed method, especially for keyword detection. The F-measure error rate for lecture keywords was reduced by 2.4%.

Full Paper

Bibliographic reference.  Yamazaki, Hiroki / Iwano, Koji / Shinoda, Koichi / Furui, Sadaoki / Yokota, Haruo (2007): "Dynamic language model adaptation using presentation slides for lecture speech recognition", In INTERSPEECH-2007, 2349-2352.