International Workshop on Spoken Language Translation (IWSLT) 2010

Paris, France
December 2-3, 2010

Analysis of Translation Model Adaptation in Statistical Machine Translation

Kevin Duh, Katsuhito Sudoh, Hajime Tsukada

NTT Communication Science Laboratories, Seika-cho, Kyoto, Japan

Numerous empirical results have shown that combining data from multiple domains often improve statistical machine translation (SMT) performance. For example, if we desire to build SMT for the medical domain, it may be beneficial to augment the training data with bitext from another domain, such as parliamentary proceedings. Despite the positive results, it is not clear exactly how and where additional outof- domain data helps in the SMT training pipeline. In this work, we analyze this problem in detail, considering the following hypotheses: out-of-domain data helps by either (a) improving word alignment or (b) improving phrase coverage. Using amultitude of datasets (IWSLT-TED, EMEA, Europarl, OpenSubtitles, KDE), we show that sometimes outof- domain data may help word alignment more than it helps phrase coverage, andmore flexible combination of data along different parts of the training pipeline may lead to better results.

Full Paper

Bibliographic reference.  Duh, Kevin / Sudoh, Katsuhito / Tsukada, Hajime (2010): "Analysis of translation model adaptation in statistical machine translation", In IWSLT-2010, 243-250.