This paper proposes a novel method for exploiting comparable documents to generate parallel data for machine translation. First, each source document is paired to each sentence of the corresponding target document; second, partial phrase alignments are computed within the paired texts; finally, fragment pairs across linked phrase-pairs are extracted. The algorithm has been tested on two recent challenging news translation tasks. Results show that mining for parallel fragments is more effective than mining for parallel sentences, and that comparable in-domain texts can be more valuable than parallel out-of-domain texts.
Cite as: Cettolo, M., Federico, M., Bertoldi, N. (2010) Mining parallel fragments from comparable texts. Proc. International Workshop on Spoken Language Translation (IWSLT 2010), 227-234
@inproceedings{cettolo10_iwslt, author={Mauro Cettolo and Marcello Federico and Nicola Bertoldi}, title={{Mining parallel fragments from comparable texts}}, year=2010, booktitle={Proc. International Workshop on Spoken Language Translation (IWSLT 2010)}, pages={227--234} }