12th Annual Conference of the International Speech Communication Association

Florence, Italy
August 27-31. 2011

Speaking to the Crowd: Looking at Past Achievements in Using Crowdsourcing for Speech and Predicting Future Challenges

Gabriel Parent, Maxine Eskenazi

Carnegie Mellon University, USA

This paper examines the literature on the use of crowdsourcing for speech-related tasks: speech acquisition, transcription and annotation as well as the assessment of speech technology. 29 papers were found, representing, 37 different experiments, which were annotated and analyzed to find trends in the field. The paper focuses on the different techniques used for quality control and the variety of sources of "crowds". Finally, we propose several challenges for the future of crowdsourcing for speech processing.

Full Paper

Bibliographic reference.  Parent, Gabriel / Eskenazi, Maxine (2011): "Speaking to the crowd: looking at past achievements in using crowdsourcing for speech and predicting future challenges", In INTERSPEECH-2011, 3037-3040.