EUROSPEECH 2003 - INTERSPEECH 2003 8th European Conference on Speech Communication and Technology Geneva, Switzerland September 1-4, 2003

Statistical Signal Processing with Nonnegativity Constraints

Lawrence K. Saul, Fei Sha, Daniel D. Lee

University of Pennsylvania, USA

Nonnegativity constraints arise frequently in statistical learning and pattern recognition. Multiplicative updates provide natural solutions to optimizations involving these constraints. One well known set of multiplicative updates is given by the Expectation- Maximization algorithm for hidden Markov models, as used in automatic speech recognition. Recently, we have derived similar algorithms for nonnegative deconvolution and nonnegative quadratic programming. These algorithms have applications to low-level problems in voice processing, such as fundamental frequency estimation, as well as high-level problems, such as the training of large margin classifiers. In this paper, we describe these algorithms and the ideas that connect them.

Full Paper

Bibliographic reference.  Saul, Lawrence K. / Sha, Fei / Lee, Daniel D. (2003): "Statistical signal processing with nonnegativity constraints", In EUROSPEECH-2003, 1001-1004.