Sixth European Conference on Speech Communication and Technology

Budapest, Hungary
September 5-9, 1999

Language Model Adaptation Using Minimum Discrimination Information

Wolfgang Reichl

Bell Laboratories, Lucent Technologies, Murray Hill, NJ, USA

In this paper, adaptation of language models using the minimum discrimination information criteria is presented. Language model probabilities are adapted based on unigram, bigram and trigram features using a modified version of the generalized iterative scaling algorithm. Furthermore, a lan-guage model compression algorithm, based on conditional relative entropy is discussed. It removes probability terms from the language model, which can be closely approximated by back-off distributions. The proposed algorithms are used to adapt a mismatched, newspaper style language model to a natural language call routing task. The experiments show a significant reduction in perplexity and word error rate for small amounts of adaptation data.

Full Paper (PDF)   Gnu-Zipped Postscript

Bibliographic reference.  Reichl, Wolfgang (1999): "Language model adaptation using minimum discrimination information", In EUROSPEECH'99, 1791-1794.