9th Annual Conference of the International Speech Communication Association

Brisbane, Australia
September 22-26, 2008

Assessment of Objective Quality Measures for Speech Intelligibility

W. M. Liu (1), K. A. Jellyman (1), N. W. D. Evans (2), John S. D. Mason (1)

(1) Swansea University, UK; (2) EURECOM, France

This paper assesses 9 prominent objective quality measures for their potential in intelligibility estimation. Degradation considered include additive noises and those introduced by coding and enhancement schemes, totalling 78 types. This paper is believed to be the first to conduct an assessment on such a large combination of quality measures and degradations allowing side-by-side analysis. Experimental results show that the sophisticated perceptual-based measures which are superior for quality estimation, do not necessarily correlate well with human intelligibility and, in fact, give poorer correlations when enhancement schemes are considered. Meanwhile, the weighted spectral slope (WSS) emerges to be the most promising approach among all measures considered, scoring the highest correlation in 5 out of the 6 test sets. Worth noting are the positive correlations obtained with WSS which range from 0.14 to 0.86, as opposed to those with PESQ from -0.58 to 0.74. Such findings put WSS, a relatively conventional measure, in a new light as a potential intelligibility assessor.

Full Paper

Bibliographic reference.  Liu, W. M. / Jellyman, K. A. / Evans, N. W. D. / Mason, John S. D. (2008): "Assessment of objective quality measures for speech intelligibility", In INTERSPEECH-2008, 699-702.