9th Annual Conference of the International Speech Communication Association

Brisbane, Australia
September 22-26, 2008

Linear Discriminant Feature Extraction Using Weighted Classification Confusion Information

Hung-Shin Lee, Berlin Chen

National Taiwan Normal University, Taiwan

Linear discriminant analysis (LDA) can be viewed as a two-stage procedure geometrically. The first stage conducts an orthogonal and whitening transformation of the variables. The second stage involves a principal component analysis (PCA) on the transformed class means, which is intended to maximize the class separability along the principal axes. In this paper, we demonstrate that the second stage does not necessarily guarantee better classification accuracy. Furthermore, we propose a generalization of LDA, weighted LDA (WLDA), by integrating the empirical classification confusion information between each class pair, such that the separability and the classification error rate can be taken into consideration simultaneously. WLDA can be efficiently solved by a lightweight eigen-decomposition and easily combined with other modifications to the LDA criterion. The experiment results show that WLDA can yield a relative character error reduction of 4.6% over LDA on the Mandarin LVCSR task.

Full Paper

Bibliographic reference.  Lee, Hung-Shin / Chen, Berlin (2008): "Linear discriminant feature extraction using weighted classification confusion information", In INTERSPEECH-2008, 2254-2257.