Automated Estimation of Oral Reading Fluency During Summer Camp e-Book Reading with MyTurnToRead

Anastassia Loukina, Beata Beigman Klebanov, Patrick Lange, Yao Qian, Binod Gyawali, Nitin Madnani, Abhinav Misra, Klaus Zechner, Zuowei Wang, John Sabatini


Use of speech technologies in the classroom is often limited by the inferior acoustic conditions as well as other factors that might affect the quality of the recordings. We describe MyTurnToRead, an e-book-based app designed to support an interleaved listening and reading experience, where the child takes turns reading aloud with a virtual partner. The child’s reading turns are recorded, and processed by an automated speech analysis system in order to provide feedback or track improvement in reading skill. We describe the architecture of the speech processing back-end and evaluate system performance on the data collected in several summer camps where children used the app on consumer-grade devices as part of the camp programming. We show that while the quality of the audio recordings varies greatly, our estimates of student oral reading fluency are very good: for example, the correlation between ASR-based and transcription-based estimates of reading fluency at the speaker level is r=0.93. These are also highly correlated with an external measure of reading comprehension.


 DOI: 10.21437/Interspeech.2019-2889

Cite as: Loukina, A., Klebanov, B.B., Lange, P., Qian, Y., Gyawali, B., Madnani, N., Misra, A., Zechner, K., Wang, Z., Sabatini, J. (2019) Automated Estimation of Oral Reading Fluency During Summer Camp e-Book Reading with MyTurnToRead. Proc. Interspeech 2019, 21-25, DOI: 10.21437/Interspeech.2019-2889.


@inproceedings{Loukina2019,
  author={Anastassia Loukina and Beata Beigman Klebanov and Patrick Lange and Yao Qian and Binod Gyawali and Nitin Madnani and Abhinav Misra and Klaus Zechner and Zuowei Wang and John Sabatini},
  title={{Automated Estimation of Oral Reading Fluency During Summer Camp e-Book Reading with MyTurnToRead}},
  year=2019,
  booktitle={Proc. Interspeech 2019},
  pages={21--25},
  doi={10.21437/Interspeech.2019-2889},
  url={http://dx.doi.org/10.21437/Interspeech.2019-2889}
}