An Incremental Turn-Taking Model for Task-Oriented Dialog Systems

Andrei C. Coman, Koichiro Yoshino, Yukitoshi Murase, Satoshi Nakamura, Giuseppe Riccardi


In a human-machine dialog scenario, deciding the appropriate time for the machine to take the turn is an open research problem. In contrast, humans engaged in conversations are able to timely decide when to interrupt the speaker for competitive or non-competitive reasons. In state-of-the-art turn-by-turn dialog systems the decision on the next dialog action is taken at the end of the utterance. In this paper, we propose a token-by-token prediction of the dialog state from incremental transcriptions of the user utterance. To identify the point of maximal understanding in an ongoing utterance, we a) implement an incremental Dialog State Tracker which is updated on a token basis (iDST) b) re-label the Dialog State Tracking Challenge 2 (DSTC2) dataset and c) adapt it to the incremental turn-taking experimental scenario. The re-labeling consists of assigning a binary value to each token in the user utterance that allows to identify the appropriate point for taking the turn. Finally, we implement an incremental Turn Taking Decider (iTTD) that is trained on these new labels for the turn-taking decision. We show that the proposed model can achieve a better performance compared to a deterministic handcrafted turn-taking algorithm.


 DOI: 10.21437/Interspeech.2019-1826

Cite as: Coman, A.C., Yoshino, K., Murase, Y., Nakamura, S., Riccardi, G. (2019) An Incremental Turn-Taking Model for Task-Oriented Dialog Systems. Proc. Interspeech 2019, 4155-4159, DOI: 10.21437/Interspeech.2019-1826.


@inproceedings{Coman2019,
  author={Andrei C. Coman and Koichiro Yoshino and Yukitoshi Murase and Satoshi Nakamura and Giuseppe Riccardi},
  title={{An Incremental Turn-Taking Model for Task-Oriented Dialog Systems}},
  year=2019,
  booktitle={Proc. Interspeech 2019},
  pages={4155--4159},
  doi={10.21437/Interspeech.2019-1826},
  url={http://dx.doi.org/10.21437/Interspeech.2019-1826}
}