Eighth ISCA Workshop on Speech Synthesis

Barcelona, Catalonia, Spain
August 31-September 2, 2013

Towards Speaking Style Transplantation in Speech Synthesis

Jaime Lorenzo-Trueba (1), Roberto Barra-Chicote (1), Junichi Yamagishi (2), Oliver Watts (2), Juan Manuel Montero (1)

(1) Speech Technology Group, ETSI Telecomunicación, UPM, Spain
(2) University of Edinburgh, UK

One of the biggest challenges in speech synthesis is the production of naturally sounding synthetic voices. This means that the resulting voice must be not only of high enough quality but also that it must be able to capture the natural expressiveness imbued in human speech. This paper focus on solving the expressiveness problem by proposing a set of different techniques that could be used for extrapolating the expressiveness of proven high quality expressive models into neutral speakers in HMM-based synthesis. As an additional advantage, the proposed techniques are based on adaptation approaches, which means that they can be used with little training data (around 15 minutes of training data are used in each style for this paper). For the final implementation, a set of 4 speaking styles were considered: news broadcasts, live sports commentary, interviews and political speech. Finally, the implementation of the 5 techniques were tested through a perceptual evaluation that proves that the deviations between neutral and expressive average models can be learned and used to imbue expressiveness into target neutral speakers as intended. Index Terms: expressive speech synthesis, speaking styles, adaptation, expressiveness transplantation

Full Paper

Bibliographic reference.  Lorenzo-Trueba, Jaime / Barra-Chicote, Roberto / , Junichi Yamagishi / Watts, Oliver / Montero, Juan Manuel (2013): "Towards speaking style transplantation in speech synthesis", In SSW8, 159-163.