Crowd-Sourced Design of Artificial Attentive Listeners

Catharine Oertel, Patrik Jonell, Dimosthenis Kontogiorgos, Joseph Mendelson, Jonas Beskow, Joakim Gustafson


Feedback generation is an important component of human-human communication. Humans can choose to signal support, understanding, agreement or also scepticism by means of feedback tokens. Many studies have focused on the timing of feedback behaviours. In the current study, however, we keep the timing constant and instead focus on the lexical form and prosody of feedback tokens as well as their sequential patterns.

For this we crowdsourced participant’s feedback behaviour in identical interactional contexts in order to model a virtual agent that is able to provide feedback as an attentive/supportive as well as attentive/sceptical listener. The resulting models were realised in a robot which was evaluated by third-party observers.


 DOI: 10.21437/Interspeech.2017-926

Cite as: Oertel, C., Jonell, P., Kontogiorgos, D., Mendelson, J., Beskow, J., Gustafson, J. (2017) Crowd-Sourced Design of Artificial Attentive Listeners. Proc. Interspeech 2017, 854-858, DOI: 10.21437/Interspeech.2017-926.


@inproceedings{Oertel2017,
  author={Catharine Oertel and Patrik Jonell and Dimosthenis Kontogiorgos and Joseph Mendelson and Jonas Beskow and Joakim Gustafson},
  title={Crowd-Sourced Design of Artificial Attentive Listeners},
  year=2017,
  booktitle={Proc. Interspeech 2017},
  pages={854--858},
  doi={10.21437/Interspeech.2017-926},
  url={http://dx.doi.org/10.21437/Interspeech.2017-926}
}