10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

Stereo-Input Speech Recognition Using Sparseness-Based Time-Frequency Masking in a Reverberant Environment

Yosuke Izumi (1), Kenta Nishiki (1), Shinji Watanabe (2), Takuya Nishimoto (1), Nobutaka Ono (1), Shigeki Sagayama (1)

(1) University of Tokyo, Japan
(2) NTT Corporation, Japan

We present noise robust automatic speech recognition (ASR) using sparseness-based underdetermined blind source separation (BSS) technique. As a representative underdetermined BSS method, we utilized time-frequency masking in this paper. Although timefrequency masking is able to separate target speech from interferences effectively, one should consider two problems. One is that masking does not work well in noisy or reverberant environment. Another is that masking itself might cause some distortion of the target speech. For the former, we apply our time-frequency masking method [7] which can separate the target signal robustly even in noisy and reverberant environment. Next, investigating the distortion caused by time-frequency masking, we reveal following facts through experiments: 1) soft mask is better than binary mask in terms of recognition performance and 2) cepstral mean normalization (CMN) reduces the distortion, especially for that caused by soft mask. At the end, we evaluate the recognition performance of our method in noisy and reverberant real environment.

Full Paper

Bibliographic reference.  Izumi, Yosuke / Nishiki, Kenta / Watanabe, Shinji / Nishimoto, Takuya / Ono, Nobutaka / Sagayama, Shigeki (2009): "Stereo-input speech recognition using sparseness-based time-frequency masking in a reverberant environment", In INTERSPEECH-2009, 1955-1958.