Spoken interaction modeling for automatic assessment of collaborative learning

Jennifer Smith, Harry Bratt, Colleen Richey, Nikoletta Bassiou, Elizabeth Shriberg, Andreas Tsiartas, Cynthia D'Angelo, Nonye Alozie


Collaborative learning is a key skill for student success, but simultaneous monitoring of multiple small groups is untenable for teachers. This study investigates whether automatic audio-based monitoring of interactions can predict collaboration quality. Data consist of hand-labeled 30-second segments from audio recordings of students as they collaborated on solving math problems. Two types of features were explored: speech activity features, which were computed at the group level; and prosodic features (pitch, energy, durational, and voice quality patterns), which were computed at the speaker level. For both feature types, normalized and unnormalized versions were investigated; the latter facilitate real-time processing applications. Results using boosting classifiers, evaluated by F-measure and accuracy, reveal that (1) both speech activity and prosody features predict quality far beyond chance using majority-class approach; (2) speech activity features are the better predictors overall, but class performance using prosody shows potential synergies; and (3) it may not be necessary to session-normalize features by speaker. These novel results have impact for educational settings, where the approach could support teachers in the monitoring of group dynamics, diagnosis of issues, and development of pedagogical intervention plans.


DOI: 10.21437/SpeechProsody.2016-57

Cite as

Smith, J., Bratt, H., Richey, C., Bassiou, N., Shriberg, E., Tsiartas, A., D'Angelo, C., Alozie, N. (2016) Spoken interaction modeling for automatic assessment of collaborative learning. Proc. Speech Prosody 2016, 277-281.

Bibtex
@inproceedings{Smith+2016,
author={Jennifer Smith and Harry Bratt and Colleen Richey and Nikoletta Bassiou and Elizabeth Shriberg and Andreas Tsiartas and Cynthia D'Angelo and Nonye Alozie},
title={Spoken interaction modeling for automatic assessment of collaborative learning},
year=2016,
booktitle={Speech Prosody 2016},
doi={10.21437/SpeechProsody.2016-57},
url={http://dx.doi.org/10.21437/SpeechProsody.2016-57},
pages={277--281}
}