ISCA Archive Eurospeech 1999
ISCA Archive Eurospeech 1999

Objective methods for evaluating synthetic intonation

Robert A.J. Clark, Kurt E. Dusterhoff

This paper describes the development and evaluation of objective methods for testing synthetic intonation. While subjective methods are available for assessing the quality of synthetic intonation, such tests consume time and resources, and are not useful for day-to-day model development. Therefore, objective measures of F0 modelling are necessary. Currently, objective evaluation of synthetic intonation involves the use of Root Mean Squared Error and Correlation. However, it is unclear how large an improvement in either score must be before it is reflected perceptually. It is also unclear how detailed an analysis these metrics provide. Therefore, two other metrics are to be tested, both of which are similar to a basic RMSE measurement. All of the evaluation results are compared to a perceptual study in order to determine how the objective measures relate to perceived differences in the contours.

doi: 10.21437/Eurospeech.1999-368

Cite as: Clark, R.A.J., Dusterhoff, K.E. (1999) Objective methods for evaluating synthetic intonation. Proc. 6th European Conference on Speech Communication and Technology (Eurospeech 1999), 1623-1626, doi: 10.21437/Eurospeech.1999-368

  author={Robert A.J. Clark and Kurt E. Dusterhoff},
  title={{Objective methods for evaluating synthetic intonation}},
  booktitle={Proc. 6th European Conference on Speech Communication and Technology (Eurospeech 1999)},