This paper reports the annotation accuracy of the Pronunciation Scaffolder (ver. 2.0), an online tool to help learners of English read presentation scripts aloud. Scripts are automatically annotated using rule- based pattern matching. Colour, font sizes and symbols are used to provide intuitive visual prompts. Annotation accuracy was evaluated by systematically checking the accuracy of all the annotation functions on a political speech. Each instance of false positive, false negative and true positive results was tagged using predefined hashcodes. The hashcodes were counted. The results show that the Pronunciation Scaffolder performed extremely well for content words and reasonably well for most other functions. However, the word stress function resulted in the many false negative results and the linking function resulted in many false positive results. These results inform the development of version 3.0.
Cite as: Kondo, T., Inoue, J., Blake, J. (2018) Pronunciation scaffolder: Annotation accuracy. Proc. International Symposium on Applied Phonetics (ISAPh 2018), 84-87, doi: 10.21437/ISAPh.2018-15
@inproceedings{kondo18_isaph,
author={Takumi Kondo and Jun Inoue and John Blake},
title={{Pronunciation scaffolder: Annotation accuracy}},
year=2018,
booktitle={Proc. International Symposium on Applied Phonetics (ISAPh 2018)},
pages={84--87},
doi={10.21437/ISAPh.2018-15}
}