Interspeech'2005 - Eurospeech

Lisbon, Portugal
September 4-8, 2005

Audio-Video Summarization of TV News Using Speech Recognition and Shot Change Detection

Chien-Lin Huang, Chia-Hsin Hsieh, Chung-Hsien Wu

National Cheng Kung University, Taiwan

This paper presents an approach to audio-video summarization of TV news to provide concise information about the content while preserves the essential message of the original. In this study, anchor speech and field report videos are considered separately. First, speech signal is automatically recognized as transcripts and a confidence measure considering syntactic and semantic relations is used to estimate the reliability of words. For video skimming, RGB color histogram difference is adopted to segment video shots and evaluate the smoothness of images concatenation. As a result, the extracted anchor speech and the field report image sequence of TV news are aggregated into a summarization output. The experimental results indicate that the proposed approach effectively extracts important speech segments and gives a concise video sequence.

Full Paper

Bibliographic reference.  Huang, Chien-Lin / Hsieh, Chia-Hsin / Wu, Chung-Hsien (2005): "Audio-video summarization of TV news using speech recognition and shot change detection", In INTERSPEECH-2005, 73-76.