ISCA Archive Interspeech 2006
ISCA Archive Interspeech 2006

Language model adaptation for tiny adaptation corpora

Dietrich Klakow

In this paper we address the issue of building language models for very small training sets by adapting existing corpora. In particular we investigate methods that combine task specific unigrams with longer range models trained on a background corpus. We propose a new method to adapt class models and show how fast marginal adaptation can be improved. Instead of estimating the adaptation unigram only on the adaptation corpus, we study specific methods to adapt unigram models as well. In extensive experimental studies we show the effectiveness of the proposed methods. As compared to FMA as described in [1] we obtain an improvement of nearly 60% for ten utterances of adaptation data.


doi: 10.21437/Interspeech.2006-575

Cite as: Klakow, D. (2006) Language model adaptation for tiny adaptation corpora. Proc. Interspeech 2006, paper 1446-Thu1A2O.4, doi: 10.21437/Interspeech.2006-575

@inproceedings{klakow06_interspeech,
  author={Dietrich Klakow},
  title={{Language model adaptation for tiny adaptation corpora}},
  year=2006,
  booktitle={Proc. Interspeech 2006},
  pages={paper 1446-Thu1A2O.4},
  doi={10.21437/Interspeech.2006-575}
}