ISCA Archive Interspeech 2015
ISCA Archive Interspeech 2015

Capcap: an output-agreement game for video captioning

Hernisa Kacorri, Kaoru Shinkawa, Shin Saito

CapCap is an output-agreement game that challenges players' listening and speaking skills. Players submit their transcriptions for short video segments against a countdown timer, in one of three pre-specified modes, to score points and support their team. Adding entertainment value, the game channels input toward captioning videos without monetary rewards. It deploys a novel human computation algorithm, which collects input from a crowd of non-experts, sequentially and in parallel, until a completion criterion is met. Rather than monetary incentive, CapCap uses motivational mechanisms like indirect feedback, mix of player skills, and community identification. Preliminary results from a field trial with mostly non-native English speakers improved the WER of English captions over ASR output.

doi: 10.21437/Interspeech.2015-592

Cite as: Kacorri, H., Shinkawa, K., Saito, S. (2015) Capcap: an output-agreement game for video captioning. Proc. Interspeech 2015, 2814-2818, doi: 10.21437/Interspeech.2015-592

  author={Hernisa Kacorri and Kaoru Shinkawa and Shin Saito},
  title={{Capcap: an output-agreement game for video captioning}},
  booktitle={Proc. Interspeech 2015},