ISCA Archive Eurospeech 1999
ISCA Archive Eurospeech 1999

Language model adaptation using minimum discrimination information

Wolfgang Reichl

In this paper, adaptation of language models using the minimum discrimination information criteria is presented. Language model probabilities are adapted based on unigram, bigram and trigram features using a modified version of the generalized iterative scaling algorithm. Furthermore, a lan-guage model compression algorithm, based on conditional relative entropy is discussed. It removes probability terms from the language model, which can be closely approximated by back-off distributions. The proposed algorithms are used to adapt a mismatched, newspaper style language model to a natural language call routing task. The experiments show a significant reduction in perplexity and word error rate for small amounts of adaptation data.


doi: 10.21437/Eurospeech.1999-359

Cite as: Reichl, W. (1999) Language model adaptation using minimum discrimination information. Proc. 6th European Conference on Speech Communication and Technology (Eurospeech 1999), 1791-1794, doi: 10.21437/Eurospeech.1999-359

@inproceedings{reichl99_eurospeech,
  author={Wolfgang Reichl},
  title={{Language model adaptation using minimum discrimination information}},
  year=1999,
  booktitle={Proc. 6th European Conference on Speech Communication and Technology (Eurospeech 1999)},
  pages={1791--1794},
  doi={10.21437/Eurospeech.1999-359}
}