ISCA Archive L2WS 2010
ISCA Archive L2WS 2010

Automatic fluency assessment by signal-level measurement of spontaneous speech

Suma Bhat, Mark Hasegawa-Johnson, Richard Sproat

In its narrow sense, the term fluency connotes fluidity of speech. This study is a step in the quest for objective language assessment methods one of which is rating for oral fluency in a second language. In particular, we seek to find what measures obtained from a spontaneous utterance can be used as predictors of fluency and, to assess the utility of a set of acoustic measures obtained by signal-level measurements towards predicting fluency automatically. Experiments done using an ESL data set of spontaneous speech show that articulation rate and phonation-time ratio are good predictors of fluency, in line with earlier findings. Our contribution is to use signal-level measurements as quantifiers of perceived fluency in a logistic regression framework and to show the existence of an alternate approach to ASR-based fluency assessment, which, owing to unacceptable levels of recognition accuracies, have limited use in real testing scenarios. Our results have implications in developing fluency assessment systems for language-resource scarce settings as well as for a wide variety of testing scenarios.


Cite as: Bhat, S., Hasegawa-Johnson, M., Sproat, R. (2010) Automatic fluency assessment by signal-level measurement of spontaneous speech. Proc. Second Language Studies: Acquisition, Learning, Education and Technology (L2WS 2010), paper O2-1

@inproceedings{bhat10_l2ws,
  author={Suma Bhat and Mark Hasegawa-Johnson and Richard Sproat},
  title={{Automatic fluency assessment by signal-level measurement of spontaneous speech}},
  year=2010,
  booktitle={Proc. Second Language Studies: Acquisition, Learning, Education and Technology (L2WS 2010)},
  pages={paper O2-1}
}