International Workshop on Spoken Language Translation (IWSLT) 2010

Paris, France
December 2-3, 2010

Overview of the IWSLT 2010 Evaluation Campaign

Michael Paul (1), Marcello Federico (2), Sebastian Stüker (3)

(1) NICT, Hikaridai, Kyoto, Japan / (2) FBK, Trento, Italy / (3) KIT, Karlsruhe, Germany

This paper gives an overview of the evaluation campaign results of the 7th International Workshop on Spoken Language Translation (IWSLT 2010) [http://iwslt2010.fbk.eu]. This year, we focused on three spoken language tasks: (1) public speeches on a variety of topics (TALK) from English to French, (2) spoken dialog in travel situations (DIALOG) between Chinese and English, and (3) traveling expressions (BTEC) from Arabic, Turkish, and French to English. In total, 28 teams (including 7 firsttime participants) took part in the shared tasks, submitting 60 primary and 112 contrastive runs. Automatic and subjective evaluations of the primary runs were carried out in order to investigate the impact of different communication modalities, spoken language styles and semantic context on automatic speech recognition (ASR) and machine translation (MT) system performances.

Full Paper

Bibliographic reference.  Paul, Michael / Federico, Marcello / Stüker, Sebastian (2010): "Overview of the IWSLT 2010 evaluation campaign", In IWSLT-2010, 3-27.