ISCA Archive Interspeech 2009
ISCA Archive Interspeech 2009

Hybridisation of expertise and reinforcement learning in dialogue systems

Romain Laroche, Ghislain Putois, Philippe Bretier, Bernadette Bouchon-Meunier

This paper addresses the problem of introducing learning capabilities in industrial handcrafted automata-based Spoken Dialogue Systems, in order to help the developer to cope with his dialogue strategies design tasks. While classical reinforcement learning algorithms position their learning at the dialogue move level, the fundamental idea behind our approach is to learn at a finer internal decision level (which question, which words, which prosody, ...). These internal decisions are made on the basis of different (distinct or overlapping) knowledge. This paper proposes a novel reinforcement learning algorithm that can be used to make a datadriven optimisation of such handcrafted systems. An experiment shows that the convergence can be up to 20 times faster than with Q-Learning.


doi: 10.21437/Interspeech.2009-660

Cite as: Laroche, R., Putois, G., Bretier, P., Bouchon-Meunier, B. (2009) Hybridisation of expertise and reinforcement learning in dialogue systems. Proc. Interspeech 2009, 2479-2482, doi: 10.21437/Interspeech.2009-660

@inproceedings{laroche09_interspeech,
  author={Romain Laroche and Ghislain Putois and Philippe Bretier and Bernadette Bouchon-Meunier},
  title={{Hybridisation of expertise and reinforcement learning in dialogue systems}},
  year=2009,
  booktitle={Proc. Interspeech 2009},
  pages={2479--2482},
  doi={10.21437/Interspeech.2009-660}
}