9th Annual Conference of the International Speech Communication Association

Brisbane, Australia
September 22-26, 2008

Multi-Stream Spectro-Temporal Features for Robust Speech Recognition

Sherry Y. Zhao, Nelson Morgan


A multi-stream approach to utilizing the inherently large number of spectro-temporal features for speech recognition is investigated in this study. Instead of reducing the feature-space dimension, this method divides the features into streams so that each represents a patch of information in the spectro-temporal response field. When used in combination with MFCCs for speech recognition under both clean and noisy conditions, multi-stream spectro-temporal features provide roughly a 30% relative improvement in word-error rate over using MFCCs alone. The result suggests that the multistream approach may be an effective way to handle and utilize spectro-temporal features for speech applications.

Full Paper

Bibliographic reference.  Zhao, Sherry Y. / Morgan, Nelson (2008): "Multi-stream spectro-temporal features for robust speech recognition", In INTERSPEECH-2008, 898-901.