10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

Improved Language Modelling Using Bag of Word Pairs

Langzhou Chen, K. K. Chin, Kate Knill

Toshiba Research Europe Ltd., UK

The bag-of-words (BoW) method has been used widely in language modelling and information retrieval. A document is expressed as a group of words disregarding the grammar and the order of word information. A typical BoW method is latent semantic analysis (LSA), which maps the words and documents onto the vectors in LSA space. In this paper, the concept of BoW is extended to Bag-of-Word Pairs (BoWP), which expresses the document as a group of word pairs. Using word pairs as a unit, the system can capture more complex semantic information than BoW. Under the LSA framework, the BoWP system is shown to improve both perplexity and word error rate (WER) compared to a BoW system.

Full Paper

Bibliographic reference.  Chen, Langzhou / Chin, K. K. / Knill, Kate (2009): "Improved language modelling using bag of word pairs", In INTERSPEECH-2009, 2671-2674.