ISCA Archive Interspeech 2021
ISCA Archive Interspeech 2021

SC-GlowTTS: An Efficient Zero-Shot Multi-Speaker Text-To-Speech Model

Edresson Casanova, Christopher Shulby, Eren Gölge, Nicolas Michael Müller, Frederico Santos de Oliveira, Arnaldo Candido Jr., Anderson da Silva Soares, Sandra Maria Aluisio, Moacir Antonelli Ponti

In this paper, we propose SC-GlowTTS: an efficient zero-shot multi-speaker text-to-speech model that improves similarity for speakers unseen during training. We propose a speaker-conditional architecture that explores a flow-based decoder that works in a zero-shot scenario. As text encoders, we explore a dilated residual convolutional-based encoder, gated convolutional-based encoder, and transformer-based encoder. Additionally, we have shown that adjusting a GAN-based vocoder for the spectrograms predicted by the TTS model on the training dataset can significantly improve the similarity and speech quality for new speakers. Our model converges using only 11 speakers, reaching state-of-the-art results for similarity with new speakers, as well as high speech quality.


doi: 10.21437/Interspeech.2021-1774

Cite as: Casanova, E., Shulby, C., Gölge, E., Müller, N.M., Oliveira, F.S.d., Candido Jr., A., Soares, A.d.S., Aluisio, S.M., Ponti, M.A. (2021) SC-GlowTTS: An Efficient Zero-Shot Multi-Speaker Text-To-Speech Model. Proc. Interspeech 2021, 3645-3649, doi: 10.21437/Interspeech.2021-1774

@inproceedings{casanova21b_interspeech,
  author={Edresson Casanova and Christopher Shulby and Eren Gölge and Nicolas Michael Müller and Frederico Santos de Oliveira and Arnaldo {Candido Jr.} and Anderson da Silva Soares and Sandra Maria Aluisio and Moacir Antonelli Ponti},
  title={{SC-GlowTTS: An Efficient Zero-Shot Multi-Speaker Text-To-Speech Model}},
  year=2021,
  booktitle={Proc. Interspeech 2021},
  pages={3645--3649},
  doi={10.21437/Interspeech.2021-1774}
}