ISCA Archive Interspeech 2005
ISCA Archive Interspeech 2005

Modeling the perception of multitalker speech

Soundararajan Srinivasan, DeLiang Wang

Listeners' ability to understand a target speaker in the presence of one or more simultaneous competing speakers is subject to two types of masking: Energetic and informational. Energetic masking occurs when target and interfering signals overlap in time and frequency resulting in portions of target becoming inaudible. Informational masking occurs when the listener is unable to segregate the target from interference, while both are audible. We present a model of multitalker speech perception that accounts for both types of masking. Human perception in the presence of energetic masking is modeled using a speech recognizer that treats the masked time-frequency units of target as missing data. The effects of informational masking on the recognizer are modeled using the output of a speech segregation system. On a systematic evaluation, the performance of the proposed model is in broad agreement with perceptual results.

doi: 10.21437/Interspeech.2005-483

Cite as: Srinivasan, S., Wang, D. (2005) Modeling the perception of multitalker speech. Proc. Interspeech 2005, 1265-1268, doi: 10.21437/Interspeech.2005-483

  author={Soundararajan Srinivasan and DeLiang Wang},
  title={{Modeling the perception of multitalker speech}},
  booktitle={Proc. Interspeech 2005},