7th International Conference on Spoken Language Processing

September 16-20, 2002
Denver, Colorado, USA

Grammar Specialisation Meets Language Modelling

Manny Rayner (1), Beth Ann Hockey (2), John Dowding (2)

(1) Netdecisions Technology Centre, U.K.; (2) NASA Ames Research Center, USA

CFG-based language models have become popular over the last few years, especially for commercial applications, and there is growing interest in creating complex CFG-based models for mixed initiative systems. On general grounds, it is attractive to attempt to compile these models from domain-independent descriptions written in high-level formalisms such as unification grammar. Experience to date however suggests that compilation from complex unification grammars to CFG has poor scalability properties. We argue that it is possible to attack this problem by first specialising the domain-independent grammar against a corpus using Explanation Based Learning. We describe experiments carried out on a medium vocabulary command and control task, which suggest that language models derived from specialised grammars have much better scalability properties, and also deliver significantly improved run-time performance.


Full Paper

Bibliographic reference.  Rayner, Manny / Hockey, Beth Ann / Dowding, John (2002): "Grammar specialisation meets language modelling", In ICSLP-2002, 913-916.