We report on the ninth evaluation campaign organized by the IWSLT workshop. This year, the evaluation offered multi- ple tracks on lecture translation based on the TED corpus, and one track on dialog translation from Chinese to English based on the Olympic trilingual corpus. In particular, the TED tracks included a speech transcription track in English, a speech translation track from English to French, and text translation tracks from English to French and from Arabic to English. In addition to the official tracks, ten unofficial MT tracks were offered that required translating TED talks into English from either Chinese, Dutch, German, Polish, Por- tuguese (Brazilian), Romanian, Russian, Slovak, Slovene, or Turkish. 16 teams participated in the evaluation and sub- mitted a total of 48 primary runs. All runs were evaluated with objective metrics, while runs of the official translation tracks were also ranked by crowd-sourced judges. In par- ticular, subjective ranking for the TED task was performed on a progress test which permitted direct comparison of the results from this year against the best results from the 2011 round of the evaluation campaign.
Cite as: Federico, M., Cettolo, M., Bentivogli, L., Paul, M., Stüker, S. (2012) Overview of the IWSLT 2012 evaluation campaign. Proc. International Workshop on Spoken Language Translation (IWSLT 2012), 12-33
@inproceedings{federico12_iwslt,
author={Marcello Federico and Mauro Cettolo and Luisa Bentivogli and Michael Paul and Sebastian Stüker},
title={{Overview of the IWSLT 2012 evaluation campaign}},
year=2012,
booktitle={Proc. International Workshop on Spoken Language Translation (IWSLT 2012)},
pages={12--33}
}