8th Annual Conference of the International Speech Communication Association

Antwerp, Belgium
August 27-31, 2007

Sentence Level Intelligibility Evaluation for Mandarin Text-to-Speech Systems Using Semantically Unpredictable Sentences

Jian Li (1), Dmitry Sityaev (2), Jie Hao (1)

(1) Toshiba (China) Co. Ltd., China
(2) Toshiba Research Europe Ltd., UK

Intelligibility assessment is one of the important aspects in the text-to-speech system (TTS) evaluation. Several intelligibility assessment

methods have been proposed and successfully applied to European

languages, both at word level and sentence level. Since Mandarin

has its own unique features, these methods must be modified when applying to Mandarin. The word level assessment methods such as DRT and MRT have successfully been modified and extended to Mandarin (e.g. CDRT, CDRT-tone and CMRT). Sentence level assessment methods, on the other hand, have not been well studied for Mandarin. This paper focuses on the Semantically Unpredictable Sentences (SUS) test, which is one of the most commonly used sentence level

assessment methods, and considers several important aspects

of the SUS test design when extending it to Mandarin. It also compares the SUS test for Mandarin with CDRT, CDRT-tone and CMRT.

Full Paper

Bibliographic reference.  Li, Jian / Sityaev, Dmitry / Hao, Jie (2007): "Sentence level intelligibility evaluation for Mandarin text-to-speech systems using semantically unpredictable sentences", In INTERSPEECH-2007, 1350-1353.