INTERSPEECH 2011 12th Annual Conference of the International Speech Communication Association Florence, Italy August 27-31. 2011

Recognition and Real Time Performances of a Lightweight Ultrasound Based Silent Speech Interface Employing a Language Model

Jun Cai (1), Bruce Denby (1), Pierre Roussel (1), Gérard Dreyfus (1), Lise Crevier-Buchman (2)

(1) SIGMA, France
(2) LPP, France

The work presents advances in the implementation of an ultrasound based silent speech interface system. Use of a portable acquisition device, a visual speech recognizer system with a language model, and real time tests with the Julius system are described. Experiments with two types of visual feature extraction are also presented. Results show that good recognition and real time performance can be obtained with a portable silent speech interface employing a language model.

Full Paper

Bibliographic reference.  Cai, Jun / Denby, Bruce / Roussel, Pierre / Dreyfus, Gérard / Crevier-Buchman, Lise (2011): "Recognition and real time performances of a lightweight ultrasound based silent speech interface employing a language model", In INTERSPEECH-2011, 1005-1008.