Sixth European Conference on Speech Communication and Technology

Budapest, Hungary
September 5-9, 1999

Class-Combined Word N-gram for Robust Language Modeling

Norihiko Kobayashi, Tetsunori Kobayashi

Dept. EECE, Waseda University, Shijuku-ku, Tokyo, Japan

We propose a method of robust language modeling for a small amount of training text corpus. In this method, the word bigram and the class bigram are combined using a weighting function of preceding word frequency. We made experiments on speech recognition using JNAS speech corpus. As the results, it was proved that the performance of the class combined bigram is equivalent to that of the word bigram trained with 2.5 larger size of corpus. We also made experiments using sports news dialogue on TV. Recognition accuracy of the class-combined bigram was 83.3% that was 5.5 point higher than that of the word bigram.

Full Paper (PDF)

Bibliographic reference.  Kobayashi, Norihiko / Kobayashi, Tetsunori (1999): "Class-combined word n-gram for robust language modeling", In EUROSPEECH'99, 1599-1602.