16th Annual Conference of the International Speech Communication Association

Dresden, Germany
September 6-10, 2015

Towards Minimum Perceptual Error Training for DNN-Based Speech Synthesis

Cassia Valentini-Botinhao, Zhizheng Wu, Simon King

University of Edinburgh, UK

We propose to use a perceptually-oriented domain to improve the quality of text-to-speech generated by deep neural networks (DNNs). We train a DNN that predicts the parameters required for speech reconstruction but whose cost function is calculated in another domain. In this paper, to represent this perceptual domain we extract an approximated version of the Spectro-Temporal Excitation Pattern that was originally proposed as part of a model of hearing speech in noise. We train DNNs that predict band aperiodicity, fundamental frequency and Mel cepstral coefficients and compare generated speech when the spectral cost function is defined in the Mel cepstral, warped log spectrum or perceptual domains. Objective results indicate that the perceptual domain system achieves the highest quality.

Full Paper

Bibliographic reference.  Valentini-Botinhao, Cassia / Wu, Zhizheng / King, Simon (2015): "Towards minimum perceptual error training for DNN-based speech synthesis", In INTERSPEECH-2015, 869-873.