Speech and Language Technology in Education (SLaTE2007)

The Summit Inn, Farmington, PA, USA
October 1-3, 2007

The Effects of Speech Recognition Errors on Learner’s Contributions, Knowledge, Emotions, and Interaction Experience

Sidney K. D’Mello, Brandon King, Michal Stolarski, Patrick Chipman, Arthur Graesser

University of Memphis, TN, USA

The paper presents a study in which participants learned computer literacy by having a spoken conversation with AutoTutor, an intelligent tutoring system with conversational dialogue. Thirty students completed a multiple-choice pre-test, a 35-minute training session, and a multiple-choice post-test. After completing the post-test, students reviewed their tutorial interaction and judged what emotions they experienced on the basis of the dialogue history and their facial expressions. Our results revealed that many measures of performance were impervious to poor or modest speech recognition accuracy, which is compatible with a soft constraint-based model. Speech recognition errors had a very subtle impact on learning as well as participants’ emotions and attitudes.

Full Paper

Bibliographic reference.  D’Mello, Sidney K. / King, Brandon / Stolarski, Michal / Chipman, Patrick / Graesser, Arthur (2007): "The effects of speech recognition errors on learner²s contributions, knowledge, emotions, and interaction experience", In SLaTE-2007, 49-52.