Interspeech'2005 - Eurospeech

Lisbon, Portugal
September 4-8, 2005

Modeling the Perception of Multitalker Speech

Soundararajan Srinivasan, DeLiang Wang

Ohio State University, Columbus, OH, USA

Listeners' ability to understand a target speaker in the presence of one or more simultaneous competing speakers is subject to two types of masking: Energetic and informational. Energetic masking occurs when target and interfering signals overlap in time and frequency resulting in portions of target becoming inaudible. Informational masking occurs when the listener is unable to segregate the target from interference, while both are audible. We present a model of multitalker speech perception that accounts for both types of masking. Human perception in the presence of energetic masking is modeled using a speech recognizer that treats the masked time-frequency units of target as missing data. The effects of informational masking on the recognizer are modeled using the output of a speech segregation system. On a systematic evaluation, the performance of the proposed model is in broad agreement with perceptual results.

Full Paper

Bibliographic reference.  Srinivasan, Soundararajan / Wang, DeLiang (2005): "Modeling the perception of multitalker speech", In INTERSPEECH-2005, 1265-1268.