ISCA Archive Interspeech 2021
ISCA Archive Interspeech 2021

Investigating Speech Reconstruction for Laryngectomees for Silent Speech Interfaces

Beiming Cao, Nordine Sebkhi, Arpan Bhavsar, Omer T. Inan, Robin Samlan, Ted Mau, Jun Wang

Silent speech interfaces (SSIs) are devices that convert non-audio bio-signals to speech, which hold the potential of recovering quality speech for laryngectomees (people who have undergone laryngectomy). Although significant progress has been made, most of the recent SSI works focused on data collected from healthy speakers. SSIs for laryngectomees have rarely been investigated. In this study, we investigated the reconstruction of speech for two laryngectomees who either use tracheoesophageal puncture (TEP) or electro-larynx (EL) speech as their post-surgery communication mode. We reconstructed their speech using two SSI designs (1) real-time recognition-and-synthesis and (2) directly articulation-to-speech synthesis (ATS). The reconstructed speech samples were measured in subjective evaluation by 20 listeners in terms of naturalness and intelligibility. The results indicated that both designs increased the naturalness of alaryngeal speech. The real-time recognition-and-synthesis design obtained higher intelligibility in electrolarynx speech as well, while the ATS did not. These preliminary results suggest the real-time recognition-and-synthesis design may have a better potential for clinical applications (for laryngectomees) than ATS.

doi: 10.21437/Interspeech.2021-1842

Cite as: Cao, B., Sebkhi, N., Bhavsar, A., Inan, O.T., Samlan, R., Mau, T., Wang, J. (2021) Investigating Speech Reconstruction for Laryngectomees for Silent Speech Interfaces. Proc. Interspeech 2021, 651-655, doi: 10.21437/Interspeech.2021-1842

  author={Beiming Cao and Nordine Sebkhi and Arpan Bhavsar and Omer T. Inan and Robin Samlan and Ted Mau and Jun Wang},
  title={{Investigating Speech Reconstruction for Laryngectomees for Silent Speech Interfaces}},
  booktitle={Proc. Interspeech 2021},