9th Annual Conference of the International Speech Communication Association

Brisbane, Australia
September 22-26, 2008

The Impact of Language Dynamics on the Capitalization of Broadcast News

Fernando Batista (1), Nuno Mamede (2), Isabel Trancoso (2)

(1) INESC-ID/ISCTE, Portugal; (2) INESC-ID/IST, Portugal

This paper investigates the impact of language dynamics on the capitalization of transcriptions of broadcast news. Most of the capitalization information is provided by a large newspaper corpus. Three different speech corpora subsets, from different time periods, are used for evaluation, assessing the importance of available training data in nearby time periods. Results are provided both for manual and automatic transcriptions, showing also the impact of the recognition errors in the capitalization task. Our approach is based on maximum entropy models, uses unlimited vocabulary, and is suitable for language adaptation. The language model for a given language period is produced by retraining a previous language model with data from that time period. The language model produced with this approach can be sorted and then pruned, in order to reduce computational resources, without much impact in the final results.

Full Paper

Bibliographic reference.  Batista, Fernando / Mamede, Nuno / Trancoso, Isabel (2008): "The impact of language dynamics on the capitalization of broadcast news", In INTERSPEECH-2008, 220-223.