11th Annual Conference of the International Speech Communication Association

Makuhari, Chiba, Japan
September 26-30. 2010

Automatic Speech Recognition for Assistive Writing in Speech Supplemented Word Prediction

John-Paul Hosom (1), Tom Jakobs (2), Allen Baker (2), Susan Fager (3)

(1) Oregon Health & Science University, USA
(2) InvoTek Inc., USA
(3) Madonna Rehabilitation Hospital, USA

This paper describes a system for assistive writing, the Speech Supplemented Word Prediction Program (SSWPP). This system uses the first letter of a word typed by the user as well as the userís (possibly low-intelligibility) speech to predict the intended word. The ASR system, which is the focus of this paper, is a speaker-dependent isolated-word recognition system. Word-level results from a non-dysarthric speaker indicate that almost all errors could be corrected by the SSWPP language model. Results from five speakers with moderate to severe dysarthria (average intelligibility 61.7%) averaged 62% for word recognition and 65% for out-of-vocabulary identification.

Full Paper

Bibliographic reference.  Hosom, John-Paul / Jakobs, Tom / Baker, Allen / Fager, Susan (2010): "Automatic speech recognition for assistive writing in speech supplemented word prediction", In INTERSPEECH-2010, 2674-2677.