This paper uses an information-based approach to conduct feature types selection for language modeling in a systematic manner. We describe a quantitative analysis of the information gain and the information redundancy for various combinations of feature types inspired by both dependency structure and bigram structure through analyzing an English treebank corpus and taking word prediction as the object. The experiments yield several conclusions on the predictive value of several feature types and feature types combinations for word prediction, which are expected to provide reliable reference for feature type selection in language modeling.
Cite as: Wu, D., Sui, Z., Zhao, J. (1999) An information-based method for selecting feature types for word prediction. Proc. 6th European Conference on Speech Communication and Technology (Eurospeech 1999), 2051-2054, doi: 10.21437/Eurospeech.1999-454
@inproceedings{wu99b_eurospeech,
author={Dekai Wu and Zhifang Sui and Jun Zhao},
title={{An information-based method for selecting feature types for word prediction}},
year=1999,
booktitle={Proc. 6th European Conference on Speech Communication and Technology (Eurospeech 1999)},
pages={2051--2054},
doi={10.21437/Eurospeech.1999-454}
}