14thAnnual Conference of the International Speech Communication Association

Lyon, France
August 25-29, 2013

Non-Negative Tensor Factorisation of Modulation Spectrograms for Monaural Sound Source Separation

Tom Barker, Tuomas Virtanen

Tampere University of Technology, Finland

This paper proposes an algorithm for separating monaural audio signals by non-negative tensor factorisation of modulation spectrograms. The modulation spectrogram is able to represent redundant patterns across frequency with similar features, and the tensor factorisation is able to isolate these patterns in an unsupervised way. The method overcomes the limitation of conventional nonnegative matrix factorisation algorithms to utilise the redundancy of sounds in frequency. In the proposed method, separated sounds are synthesised by filtering the mixture signal with a Wiener-like filter generated from the estimated tensor factors. The proposed method was compared to conventional algorithms in unsupervised separation of mixtures of speech and music. Improved signal to distortion ratios were obtained compared to standard non-negative matrix factorisation and non-negative matrix deconvolution.

Full Paper

Bibliographic reference.  Barker, Tom / Virtanen, Tuomas (2013): "Non-negative tensor factorisation of modulation spectrograms for monaural sound source separation", In INTERSPEECH-2013, 827-831.