8th International Conference on Spoken Language Processing

Jeju Island, Korea
October 4-8, 2004

Discriminative Training of Naive Bayes Classifiers for Natural Language Call Routing

Hui Jiang (1), Pengfei Liu (1), Imed Zitouni (2)

(1) York University, Canada
(2) IBM, USA

In this paper, we propose to use a discriminative training method to improve naive Bayes classifiers(NBC) in context of natural language call routing. As opposed to the traditional maximum likelihood estimation, all conditional probabilties in Naive Bayes classifers are estimated discriminatively based on the minimum classification error criterion. A smoothed classification error rate in training set is formulated as an objective function and the generalized probabilistic descent method is used to minimize the objective function with respect to all conditional probabilities in NBCs. Two versions of NBC are used in this work. In the first version all NBCs corresponding to various destinations use the same word feature set while destination-dependent feature set is chosen for each destination in the second version. Experimental results on a banking call routing task show that the discriminative training method can achieve up to about 30% error reduction over our best ML-trained system.

Full Paper

Bibliographic reference.  Jiang, Hui / Liu, Pengfei / Zitouni, Imed (2004): "Discriminative training of naive Bayes classifiers for natural language call routing", In INTERSPEECH-2004, 1589-1592.