10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

Disordered Speech Recognition Using Acoustic and sEMG Signals

Yunbin Deng (1), Rupal Patel (2), James T. Heaton (3), Glen Colby (1), L. Donald Gilmore (4), Joao Cabrera (1), Serge H. Roy (4), Carlo J. De Luca (4), Geoffrey S. Meltzner (1)

(1) BAE Systems Inc., USA
(2) Northeastern University, USA
(3) Massachusetts General Hospital, USA
(4) Delsys Inc., USA

Parallel isolated word corpora were collected from healthy speakers and individuals with speech impairment due to stroke or cerebral palsy. Surface electromyographic (sEMG) signals were collected for both vocalized and mouthed speech production modes. Pioneering work on disordered speech recognition using the acoustic signal, the sEMG signals, and their fusion are reported. Results indicate that speaker-dependent isolated-word recognition from the sEMG signals of articulator muscle groups during vocalized disorderedspeech production was highly effective. However, word recognition accuracy for mouthed speech was much lower, likely related to the fact that some disordered speakers had considerable difficulty producing consistent mouthed speech. Further development of the sEMG-based speech recognition systems is needed to increase usability and robustness.

Full Paper

Bibliographic reference.  Deng, Yunbin / Patel, Rupal / Heaton, James T. / Colby, Glen / Gilmore, L. Donald / Cabrera, Joao / Roy, Serge H. / Luca, Carlo J. De / Meltzner, Geoffrey S. (2009): "Disordered speech recognition using acoustic and sEMG signals", In INTERSPEECH-2009, 644-647.