ISCA International Workshop on Speech and Language Technology in Education (SLaTE 2009)

Wroxall Abbey Estate, Warwickshire, England
September 3-5, 2009

Analysis and Comparison of Automatic Language Proficiency Assessment between Shadowed Sentences and Read Sentences

Dean Luo (1), Nobuaki Minematsu (1), Yutaka Yamauchi (2), Keikichi Hirose (1)

(1) The University of Tokyo, (2) Tokyo International University, Japan

In this paper, we investigate automatic language proficiency assessment from learners’ utterances generated through shadowing and reading aloud. By increasing the degrees of difficulty of learners’ tasks for each practice, we examine how the automatic scores, the conventional GOP and proposed F-GOP, change according to the cognitive loads posed on learners. We also investigate the effect and side-effect of MLLR (Maximum Likelihood Linear Regression) adaptation on shadowing and reading aloud. Experimental results show that shadowing can better reflect the learners’ true proficiency than reading aloud. Global MLLR adaptation can improve the evaluation performances on reading aloud more significantly than shadowing. But the performance is still better in shadowing. Finally we show that, by selecting native utterances of adequate semantic difficulty, the evaluation performance by shadowing is even improved.

Full Paper

Bibliographic reference.  Luo, Dean / Minematsu, Nobuaki / Yamauchi, Yutaka / Hirose, Keikichi (2009): "Analysis and comparison of automatic language proficiency assessment between shadowed sentences and read sentences", In SLaTE-2009, 37-40.