ISCA Archive Eurospeech 1999
ISCA Archive Eurospeech 1999

The beta-binomial mixture model for word frequencies in documents with applications to information retrieval

Stephen A. Lowe

This paper describes a continuous-mixture statistical model for word occurrence frequencies in documents, and the application of that model to the DARPA-sponsored TDT topic identification tasks [1]. This model was originally proposed in 1990 by L. Gillick [2] as a means to account for variation in word frequencies across documents more accurately than the binomial model. The present paper presents further mathematical development of the model, leading to the implementation of a topic-tracking system. Performance results for this system on the Tracking Task in the December 1998 DARPA TDT Evaluation will be shown and compared with Dragon’s existing, more complex multinomial-model-based system. (Results from other systems applied to this task are available in [3].) We will conclude with plans for further development.


doi: 10.21437/Eurospeech.1999-537

Cite as: Lowe, S.A. (1999) The beta-binomial mixture model for word frequencies in documents with applications to information retrieval. Proc. 6th European Conference on Speech Communication and Technology (Eurospeech 1999), 2443-2446, doi: 10.21437/Eurospeech.1999-537

@inproceedings{lowe99_eurospeech,
  author={Stephen A. Lowe},
  title={{The beta-binomial mixture model for word frequencies in documents with applications to information retrieval}},
  year=1999,
  booktitle={Proc. 6th European Conference on Speech Communication and Technology (Eurospeech 1999)},
  pages={2443--2446},
  doi={10.21437/Eurospeech.1999-537}
}