14thAnnual Conference of the International Speech Communication Association

Lyon, France
August 25-29, 2013

Dysarthric Speech Recognition Using Dysarthria-Severity-Dependent and Speaker-Adaptive Models

Myung Jong Kim, Joohong Yoo, Hoirin Kim

KAIST, Korea

Dysarthria is a motor speech disorder that impairs the physical production of speech. Modern automatic speech recognition for normal speech is ineffective for dysarthric speech due to the large mismatch of acoustic characteristics. In this paper, a new speaker adap- tation scheme is proposed to reduce the mismatch. First, a speaker with dysarthria is classified into one of the pre-defined severitylevels, and then an initial model to be adapted is selected depending on their severity-level. The candidates of an initial model are generated using dysarthric speech associated with their labeled severitylevel in the training phase. Finally, speaker adaptation is applied to the selected initial model. Evaluation of the proposed method on a database of several hundred words for 31 speakers with moderate to mild dysarthria showed that the proposed approach provides substantial improvement over the conventional speaker-adaptive system when a small amount of adaptation data is available.

Full Paper

Bibliographic reference.  Kim, Myung Jong / Yoo, Joohong / Kim, Hoirin (2013): "Dysarthric speech recognition using dysarthria-severity-dependent and speaker-adaptive models", In INTERSPEECH-2013, 3622-3626.