15th Annual Conference of the International Speech Communication Association

September 14-18, 2014

An Evaluation of Unsupervised Acoustic Model Training for a Dysarthric Speech Interface

Oliver Walter (1), Vladimir Despotovic (1), Reinhold Haeb-Umbach (1), Jort F. Gemmeke (2), Bart Ons (2), Hugo Van hamme (2)

(1) Universität Paderborn, Germany
(2) Katholieke Universiteit Leuven, Belgium

In this paper, we investigate unsupervised acoustic model training approaches for dysarthric-speech recognition. These models are first, frame-based Gaussian posteriorgrams, obtained from Vector Quantization (VQ), second, so-called Acoustic Unit Descriptors (AUDs), which are hidden Markov models of phone-like units, that are trained in an unsupervised fashion, and, third, posteriorgrams computed on the AUDs. Experiments were carried out on a database collected from a home automation task and containing nine speakers, of which seven are considered to utter dysarthric speech. All unsupervised modeling approaches delivered significantly better recognition rates than a speaker-independent phoneme recognition baseline, showing the suitability of unsupervised acoustic model training for dysarthric speech. While the AUD models led to the most compact representation of an utterance for the subsequent semantic inference stage, posteriorgram-based representations resulted in higher recognition rates, with the Gaussian posteriorgram achieving the highest slot filling F-score of 97.02%.

Full Paper

Bibliographic reference.  Walter, Oliver / Despotovic, Vladimir / Haeb-Umbach, Reinhold / Gemmeke, Jort F. / Ons, Bart / Van hamme, Hugo (2014): "An evaluation of unsupervised acoustic model training for a dysarthric speech interface", In INTERSPEECH-2014, 1013-1017.