ISCA Archive Interspeech 2013
ISCA Archive Interspeech 2013

Combining perceptually-motivated spectral shaping with loudness and duration modification for intelligibility enhancement of HMM-based synthetic speech in noise

Cassia Valentini-Botinhao, Junichi Yamagishi, Simon King, Yannis Stylianou

This paper presents our entry to a speech-in-noise intelligibility enhancement evaluation: the Hurricane Challenge. The system consists of a Text-To-Speech voice manipulated through a combination of enhancement strategies, each of which is known to be individually successful: a perceptually-motivated spectral shaper based on the Glimpse Proportion measure, dynamic range compression, and adaptation to Lombard excitation and duration patterns. We achieved substantial intelligibility improvements relative to unmodified synthetic speech: 4.9 dB in competing speaker and 4.1 dB in speech-shaped noise. An analysis conducted across this and other two similar evaluations shows that the spectral shaper and the compressor (both of which are loudness boosters) contribute most under higher SNR conditions, particularly for speech-shaped noise. Duration and excitation Lombard-adapted changes are more beneficial in lower SNR conditions, and for competing speaker noise.


doi: 10.21437/Interspeech.2013-767

Cite as: Valentini-Botinhao, C., Yamagishi, J., King, S., Stylianou, Y. (2013) Combining perceptually-motivated spectral shaping with loudness and duration modification for intelligibility enhancement of HMM-based synthetic speech in noise. Proc. Interspeech 2013, 3567-3571, doi: 10.21437/Interspeech.2013-767

@inproceedings{valentinibotinhao13_interspeech,
  author={Cassia Valentini-Botinhao and Junichi Yamagishi and Simon King and Yannis Stylianou},
  title={{Combining perceptually-motivated spectral shaping with loudness and duration modification for intelligibility enhancement of HMM-based synthetic speech in noise}},
  year=2013,
  booktitle={Proc. Interspeech 2013},
  pages={3567--3571},
  doi={10.21437/Interspeech.2013-767}
}