Reliability of the listening test design has a great influence on the performance of the quality estimation model. In this paper we compare four different listening test designs by Monte Carlo simulation. Three common problems of interval scale ratings are included in the simulation, and their influences on the performance of estimating the underlying true quality are investigated. It turns out that in these methods, randomly choosing partial trials for Scaled Comparison could be the most reliable way to perform listening test under the influences of interval scale ratings problems.
Cite as: Chen, S.-H., Chen, S.-J., Kuo, C.-C. (2006) Comparison and analysis of listening test methods for development of perceptual speech quality assessment. Proc. 2nd ISCA/DEGA Tutorial and Research Workshop on Perceptual Quality of Systems (PQS 2006), 79-84
@inproceedings{chen06_pqs,
author={Shi-Han Chen and Shun-Ju Chen and Chih-Chung Kuo},
title={{Comparison and analysis of listening test methods for development of perceptual speech quality assessment}},
year=2006,
booktitle={Proc. 2nd ISCA/DEGA Tutorial and Research Workshop on Perceptual Quality of Systems (PQS 2006)},
pages={79--84}
}