8th European Conference on Speech Communication and Technology

Geneva, Switzerland
September 1-4, 2003


A Cross-Media Retrieval System for Lecture Videos

Atsushi Fujii (1), Katunobu Itou (2), Tomoyosi Akiba (2), Tetsuya Ishikawa (1)

(1) University of Tsukuba, Japan
(2) AIST, Japan

We propose a cross-media lecture-on-demand system, in which users can selectively view specific segments of lecture videos by submitting text queries. Users can easily formulate queries by using the textbook associated with a target lecture, even if they cannot come up with effective keywords. Our system extracts the audio track from a target lecture video, generates a transcription by large vocabulary continuous speech recognition, and produces a text index. Experimental results showed that by adapting speech recognition to the topic of the lecture, the recognition accuracy increased and the retrieval accuracy was comparable with that obtained by human transcription.

Full Paper

Bibliographic reference.  Fujii, Atsushi / Itou, Katunobu / Akiba, Tomoyosi / Ishikawa, Tetsuya (2003): "A cross-media retrieval system for lecture videos", In EUROSPEECH-2003, 1149-1152.