ISCA Archive SpeechProsody 2022
ISCA Archive SpeechProsody 2022

Amplitude envelope modulations across languages reflect prosody

Sónia Frota, Marina Vigário, Marisa Cruz, Friederike Hohl, Bettina Braun

The speech signal has been shown to contain a fine structure that consists of the fast changing spectral content (e.g., formant transitions, voicing, spectral energy distributions), together with amplitude modulations of the envelope with different timescales. These different modulation frequencies have been associated with linguistic units of different sizes, and neuronal oscillations seem to track this linguistic structure. As the amplitude envelope mostly captures suprasegmental information, the different modulation frequencies are natural candidates to convey prosodic information. In this paper we put these assumptions to test by comparing effects of sentence length and language, focusing on languages with distinct prosodic profiles: Brazilian Portuguese (syllable-timed), European Portuguese (mixed rhythm, with syllable-timed and stress-timed properties), and German (stress-timed). There are further differences regarding the roles of the syllable, the foot, the prosodic word and the intonation phrase. In this paper, we analyzed wideband amplitude envelopes using general additive mixed models and show that German differs from Brazilian Portuguese and European Portuguese in the delta (1-2Hz) and theta bands (6-8Hz). European and Brazilian Portuguese also differ, but only in the delta band (1-2Hz). The language differences in amplitude modulation are discussed in terms of speech rhythm and differences in prosodic structure across languages.


doi: 10.21437/SpeechProsody.2022-140

Cite as: Frota, S., Vigário, M., Cruz, M., Hohl, F., Braun, B. (2022) Amplitude envelope modulations across languages reflect prosody. Proc. Speech Prosody 2022, 688-692, doi: 10.21437/SpeechProsody.2022-140

@inproceedings{frota22_speechprosody,
  author={Sónia Frota and Marina Vigário and Marisa Cruz and Friederike Hohl and Bettina Braun},
  title={{Amplitude envelope modulations across languages reflect prosody}},
  year=2022,
  booktitle={Proc. Speech Prosody 2022},
  pages={688--692},
  doi={10.21437/SpeechProsody.2022-140}
}