Does the Lombard Effect Improve Emotional Communication in Noise? — Analysis of Emotional Speech Acted in Noise

Yi Zhao, Atsushi Ando, Shinji Takaki, Junichi Yamagishi, Satoshi Kobashikawa


Speakers usually adjust their way of talking in noisy environments involuntarily for effective communication. This adaptation is known as the Lombard effect. Although speech accompanying the Lombard effect can improve the intelligibility of a speaker’s voice, the changes in acoustic features (e.g. fundamental frequency, speech intensity, and spectral tilt) caused by the Lombard effect may also affect the listener’s judgment of emotional content. To the best of our knowledge, there is no published study on the influence of the Lombard effect in emotional speech. Therefore, we recorded parallel emotional speech waveforms uttered by 12 speakers under both quiet and noisy conditions in a professional recording studio in order to explore how the Lombard effect interacts with emotional speech. By analyzing confusion matrices and acoustic features, we aim to answer the following questions: 1) Can speakers express their emotions correctly even under adverse conditions? 2) Can listeners recognize the emotion contained in speech signals even under noise? 3) How does emotional speech uttered in noise differ from emotional speech uttered in quiet conditions in terms of acoustic characteristic?


 DOI: 10.21437/Interspeech.2019-1605

Cite as: Zhao, Y., Ando, A., Takaki, S., Yamagishi, J., Kobashikawa, S. (2019) Does the Lombard Effect Improve Emotional Communication in Noise? — Analysis of Emotional Speech Acted in Noise. Proc. Interspeech 2019, 3292-3296, DOI: 10.21437/Interspeech.2019-1605.


@inproceedings{Zhao2019,
  author={Yi Zhao and Atsushi Ando and Shinji Takaki and Junichi Yamagishi and Satoshi Kobashikawa},
  title={{Does the Lombard Effect Improve Emotional Communication in Noise? — Analysis of Emotional Speech Acted in Noise}},
  year=2019,
  booktitle={Proc. Interspeech 2019},
  pages={3292--3296},
  doi={10.21437/Interspeech.2019-1605},
  url={http://dx.doi.org/10.21437/Interspeech.2019-1605}
}