ISCA Archive Interspeech 2005
ISCA Archive Interspeech 2005

Language model data filtering via user simulation and dialogue resynthesis

Chao Wang, Stephanie Seneff, Grace Chung

In this paper, we address the issue of generating language model training data during the initial stages of dialogue system development. The process begins with a large set of sentence templates, automatically adapted from other application domains. We propose two methods to filter the raw data set to achieve a desired probability distribution of the semantic content, both on the sentence level and on the class level. The first method utilizes user simulation technology, which obtains the probability model via an interplay between a probabilistic user model and the dialogue system. The second method synthesizes novel dialogue interactions by modeling after a small set of dialogues produced by the developers during the course of system refinement. We evaluated our methodology by speech recognition performance on a set of 520 unseen utterances from naive users interacting with a restaurant domain dialogue system.


doi: 10.21437/Interspeech.2005-8

Cite as: Wang, C., Seneff, S., Chung, G. (2005) Language model data filtering via user simulation and dialogue resynthesis. Proc. Interspeech 2005, 21-24, doi: 10.21437/Interspeech.2005-8

@inproceedings{wang05_interspeech,
  author={Chao Wang and Stephanie Seneff and Grace Chung},
  title={{Language model data filtering via user simulation and dialogue resynthesis}},
  year=2005,
  booktitle={Proc. Interspeech 2005},
  pages={21--24},
  doi={10.21437/Interspeech.2005-8}
}