15th Annual Conference of the International Speech Communication Association

September 14-18, 2014

Analysis of Phonetic Similarity in a Silent Speech Interface Based on Permanent Magnetic Articulography

Jose A. Gonzalez (1), Lam A. Cheah (2), Jie Bai (2), Stephen R. Ell (3), James M. Gilbert (2), Roger K. Moore (1), Phil D. Green (1)

(1) University of Sheffield, UK
(2) University of Hull, UK
(3) Castle Hill Hospital, UK

This paper investigates the potential of a silent speech interface (SSI) based on Permanent Magnetic Articulography (PMA) to be used in applications involving unconstrained, phonetically rich speech. In previous work the SSI was evaluated on isolated-word and connected-digits recognition tasks with promising results. Furthermore, it was shown that PMA data is enough to distinguish between minimal pairs of consonants with the same manner and place of articulation but different voicing. The study presented in this paper extends previous work by investigating to what extent information about the speech production process can be recovered from PMA data. In particular, the three main aspects of speech production are investigated here: voicing, place of articulation and manner of articulation. The results show that PMA achieves comparable accuracy to using the audio signal for discriminating the place of articulation of consonants, but it provides little information regarding the voicing and manner of articulation.

Full Paper

Bibliographic reference.  Gonzalez, Jose A. / Cheah, Lam A. / Bai, Jie / Ell, Stephen R. / Gilbert, James M. / Moore, Roger K. / Green, Phil D. (2014): "Analysis of phonetic similarity in a silent speech interface based on permanent magnetic articulography", In INTERSPEECH-2014, 1018-1022.