Voice Restoration with Silent Speech Interfaces (ReSSInt)

Inma Hernaez, Jose Andrés González-López, Eva Navas, Jose Luis Pérez Córdoba, Ibon Saratxaga, Gonzalo Olivares, Jon Sánchez de la Fuente, Alberto Galdón, Víctor García Romillo, Míriam González-Atienza, Tanja Schultz, Phil Green, Michael Wand, Ricard Marxer, Lorenz Diener

ReSSInt aims at investigating the use of silent speech interfaces (SSIs) for restoring communication to individuals who have been deprived of the ability to speak. SSIs are devices which capture non-acoustic biosignals generated during the speech production process and use them to predict the intended message. Two are the biosignals that will be investigated in this project: electromyography (EMG) signals representing electrical activity driving the facial muscles and invasive electroencephalography (iEEG) neural signals captured by means of invasive electrodes implanted on the brain. From the whole spectrum of speech disorders which may affect a person’s voice, ReSSInt will address two particular conditions: (i) voice loss after total laryngectomy and (ii) neurodegenerative diseases and other traumatic injuries which may leave an individual paralyzed and, eventually, unable to speak. To make this technology truly beneficial for these persons, this project aims at generating intelligible speech of reasonable quality. This will be tackled by recording large databases and the use of state-of-the-art generative deep learning techniques. Finally, different voice rehabilitation scenarios are foreseen within the project, which will lead to innovative research solutions for SSIs and a real impact on society by improving the life of people with speech impediments.

doi: 10.21437/IberSPEECH.2021-28

Hernaez, I, González-López, J.A, Navas, E, Pérez Córdoba, J.L, Saratxaga, I, Olivares, G, Sánchez de la Fuente, J, Galdón, A, García Romillo, V, González-Atienza, M, Schultz, T, Green, P, Wand, M, Marxer, R, Diener, L (2021) Voice Restoration with Silent Speech Interfaces (ReSSInt). Proc. IberSPEECH 2021, 130-134, doi: 10.21437/IberSPEECH.2021-28.