International Workshop on Spoken Language Translation (IWSLT) 2004 Keihanna Science City, Kyoto, Japan September 30-October 1, 2004

Spoken Dialogue Translation Systems Evaluation: Results, New Trends, Problems and Proposals

Hervé Blanchon, Christian Boitet, Laurent Besacier

Laboratoire CLIPS, Grenoble, France

It is important to evaluate Spoken Dialogue Translation Systems, but as we show by analyzing evaluation methods in the Verbmobil, C-STAR II, and the Nespole! projects, the current state of the art is not fully satisfactory. Subjective methods are too costly, and objective methods, although cheaper, don't give good indications about usability. We propose some ideas to improve that situation.

Full Paper   

Bibliographic reference.  Blanchon, Hervé / Boitet, Christian / Besacier, Laurent (2004): "Spoken dialogue translation systems evaluation: results, new trends, problems and proposals", In IWSLT-2004, 95-102.