ISCA Archive Interspeech 2008
ISCA Archive Interspeech 2008

Inductive and example-based learning for text classification

Ye-Yi Wang, Xiao Li, Alex Acero

Text classification has been widely applied to many practical tasks. Inductive models trained from labeled data are the most commonly used technique. The basic assumption underlying an inductive model is that the training data are drawn from the same distribution as the test data. However, labeling such a training set is often expensive for practical applications. On the other hand, a large amount of labeled data, which have been drawn from a different distribution, is often available in the same application domain. It is thus very desirable to take advantage of these data even though there is a discrepancy between their underlying distribution and that of the test set. This paper compares three text classification algorithms applied in this scenario, including two inductive Maximum Entropy (MaxEnt) models, one flatly initialized and the other initialized with a term-frequency/inverse document frequency (Tf.Idf) weighted vector space model, and an examplebased learning algorithm, which assigns a class label to a text by learning from the labels assigned to the training data that are similar to the text. Experiment results show that example-based learning has achieved more than 5% improvement in precisions across almost all coverage levels.

doi: 10.21437/Interspeech.2008-269

Cite as: Wang, Y.-Y., Li, X., Acero, A. (2008) Inductive and example-based learning for text classification. Proc. Interspeech 2008, 1610-1613, doi: 10.21437/Interspeech.2008-269

  author={Ye-Yi Wang and Xiao Li and Alex Acero},
  title={{Inductive and example-based learning for text classification}},
  booktitle={Proc. Interspeech 2008},