ESCA Workshop on Prosody Lund, Sweden September 27-29, 1993

Judgement on Quality and Diagnostic Evaluation of Synthetic Prosody

Serge Santi, Isabelle Guaïtella

Institut de Phonétique d'Aix-en-Provence, Laboratoire Parole et Langage URA CNRS 261, France

Two original methods of evaluation of synthetic prosody have been developped and applied to three prosodic rule generators using four French dialogue oriented applications (plane tickets reservation, remote inquiry of databases, etc.). Our data show a good correspondance between the results of two tests. They are both capable of discriminating between algorithms according to each type of application. Each method seem to meet our expectations, i.e., evaluation of quality only vs diagnostic evaluation. The question of what is to be evaluated must be answered before determining how to evaluate.

Full Paper

Bibliographic reference.  Santi, Serge / Guaïtella, Isabelle (1993): "Judgement on quality and diagnostic evaluation of synthetic prosody", In Prosody-1993, 224-227.