2nd International Workshop on Speech, Language and Audio in Multimedia (SLAM2014)

Penang, Malaysia
September 11-12, 2014

Development of a Genre-Dependent TTS System with Cross-Speaker Speaking-Style Transplantation

Jaime Lorenzo-Trueba (1), Julián D. Echeverry-Correa (1), Roberto Barra-Chicote (1), Rubén San-Segundo (1), Javier Ferreiros (1), Ascensión Gallardo-Antolín (4), Junichi Yamagishi (2,3), Simon King (2), Juan M. Montero (1)

(1) Speech Technology Group. E.T.S.I. Telecomunicación. Universidad Politecnica de Madrid (UPM), Spain
(2) Centre for Speech Technology Research (CSTR), University of Edinburgh, UK
(3) National Institute of Informatics (NII), Tokyo, Japan
(4) Universidad Carlos III de Madrid (UC3M), Spain

One of the biggest challenges in speech synthesis is the production of contextually-appropriate naturally sounding synthetic voices. This means that a Text-To-Speech system must be able to analyze a text beyond the sentence limits in order to select, or even modulate, the speaking style according to a broader context. Our current architecture is based on a two-step approach: text genre identification and speaking style synthesis according to the detected discourse genre. For the final implementation, a set of four genres and their corresponding speaking styles were considered: broadcast news, live sport commentaries, interviews and political speeches. In the final TTS evaluation, the four speaking styles were transplanted to the neutral voices of other speakers not included in the training database. When the transplanted styles were compared to the neutral voices, transplantation was significantly preferred and the similarity to the target speaker was as high as 78%.

Index Terms: speech synthesis, speaking style transplantation, automatic genre identification, Latent Semantic Analysis

Full Paper

Bibliographic reference.  Lorenzo-Trueba, Jaime / Echeverry-Correa, Julián D. / Barra-Chicote, Roberto / San-Segundo, Rubén / Ferreiros, Javier / Gallardo-Antolín, Ascensión / Yamagishi, Junichi / King, Simon / Montero, Juan M. (2014): "Development of a genre-dependent TTS system with cross-speaker speaking-style transplantation", In SLAM-2014, 39-42.