A New Workflow for Semi-Automatized Annotations: Tests with Long-Form Naturalistic Recordings of Childrens Language Environments

Marisa Casillas, Elika Bergelson, Anne S. Warlaumont, Alejandrina Cristia, Melanie Soderstrom, Mark VanDam, Han Sloetjes


Interoperable annotation formats are fundamental to the utility, expansion, and sustainability of collective data repositories. In language development research, shared annotation schemes have been critical to facilitating the transition from raw acoustic data to searchable, structured corpora. Current schemes typically require comprehensive and manual annotation of utterance boundaries and orthographic speech content, with an additional, optional range of tags of interest. These schemes have been enormously successful for datasets on the scale of dozens of recording hours but are untenable for long-format recording corpora, which routinely contain hundreds to thousands of audio hours. Long-format corpora would benefit greatly from (semi-)automated analyses, both on the earliest steps of annotation — voice activity detection, utterance segmentation, and speaker diarization — as well as later steps — e.g., classification-based codes such as child-vs-adult-directed speech, and speech recognition to produce phonetic/orthographic representations. We present an annotation workflow specifically designed for long-format corpora which can be tailored by individual researchers and which interfaces with the current dominant scheme for short-format recordings. The workflow allows semi-automated annotation and analyses at higher linguistic levels. We give one example of how the workflow has been successfully implemented in a large cross-database project.


 DOI: 10.21437/Interspeech.2017-1418

Cite as: Casillas, M., Bergelson, E., Warlaumont, A.S., Cristia, A., Soderstrom, M., VanDam, M., Sloetjes, H. (2017) A New Workflow for Semi-Automatized Annotations: Tests with Long-Form Naturalistic Recordings of Childrens Language Environments. Proc. Interspeech 2017, 2098-2102, DOI: 10.21437/Interspeech.2017-1418.


@inproceedings{Casillas2017,
  author={Marisa Casillas and Elika Bergelson and Anne S. Warlaumont and Alejandrina Cristia and Melanie Soderstrom and Mark VanDam and Han Sloetjes},
  title={A New Workflow for Semi-Automatized Annotations: Tests with Long-Form Naturalistic Recordings of Childrens Language Environments},
  year=2017,
  booktitle={Proc. Interspeech 2017},
  pages={2098--2102},
  doi={10.21437/Interspeech.2017-1418},
  url={http://dx.doi.org/10.21437/Interspeech.2017-1418}
}