Paragraph-based prosodic cues for speech synthesis applications

Mireia Farrús, Catherine Lai, Johanna D. Moore

Speech synthesis has improved in both expressiveness and voice quality in recent years. However, obtaining full expressiveness when dealing with large multisentential synthesized discourse is still a challenge, since speech synthesizers do not take into account the prosodic differences that have been observed in discourse units such as paragraphs. The current study validates and extends previous work by analyzing the prosody of paragraph units on a large and diverse corpus of TED Talks using automatically extracted F0, intensity and timing features. Moreover, a series of classification experiments was performed in order to identify which features are consistently used to distinguish paragraph breaks. The results show significant differences in prosody related to paragraph position. In addition, the classification experiments show that boundary features such as pause duration and differences in F0 and intensity levels are the most consistent cues in marking paragraph boundaries. This suggests that these features should be taken into account when generating spoken discourse in order to improve naturalness and expressiveness.

DOI: 10.21437/SpeechProsody.2016-235

Cite as

Farrús, M., Lai, C., Moore, J.D. (2016) Paragraph-based prosodic cues for speech synthesis applications. Proc. Speech Prosody 2016, 1143-1147.

author={Mireia Farrús and Catherine Lai and Johanna D. Moore},
title={Paragraph-based prosodic cues for speech synthesis applications},
booktitle={Speech Prosody 2016},