ISCA Archive Interspeech 2005
ISCA Archive Interspeech 2005

Detecting certainness in spoken tutorial dialogues

Jackson Liscombe, Julia Hirschberg, Jennifer J. Venditti

What role does affect play in spoken tutorial systems and is it automatically detectable? We investigated the classification of student certainness in a corpus collected for ITSPOKE, a speechenabled Intelligent Tutorial System (ITS). Our study suggests that tutors respond to indications of student uncertainty differently from student certainty. Results of machine learning experiments indicate that acoustic-prosodic features can distinguish student certainness from other student states. A combination of acousticprosodic features extracted at two levels of intonational analysis - breath groups and turns - achieves 76.42% classification accuracy, a 15.8% relative improvement over baseline performance. Our results suggest that student certainness can be automatically detected and utilized to create better spoke dialog ITSs.

doi: 10.21437/Interspeech.2005-581

Cite as: Liscombe, J., Hirschberg, J., Venditti, J.J. (2005) Detecting certainness in spoken tutorial dialogues. Proc. Interspeech 2005, 1837-1840, doi: 10.21437/Interspeech.2005-581

  author={Jackson Liscombe and Julia Hirschberg and Jennifer J. Venditti},
  title={{Detecting certainness in spoken tutorial dialogues}},
  booktitle={Proc. Interspeech 2005},