ISCA Archive Interspeech 2021
ISCA Archive Interspeech 2021

Protecting Gender and Identity with Disentangled Speech Representations

Dimitrios Stoidis, Andrea Cavallaro

Besides its linguistic content, our speech is rich in biometric information that can be inferred by classifiers. Learning privacy-preserving representations for speech signals enables downstream tasks without sharing unnecessary, private information about an individual. In this paper, we show that protecting gender information in speech is more effective than modelling speaker-identity information only when generating a non-sensitive representation of speech. Our method relies on reconstructing speech by decoding linguistic content along with gender information using a variational autoencoder. Specifically, we exploit disentangled representation learning to encode information about different attributes into separate subspaces that can be factorised independently. We present a novel way to encode gender information and disentangle two sensitive biometric identifiers, namely gender and identity, in a privacy-protecting setting. Experiments on the LibriSpeech dataset show that gender recognition and speaker verification can be reduced to a random guess, protecting against classification-based attacks.

doi: 10.21437/Interspeech.2021-2163

Cite as: Stoidis, D., Cavallaro, A. (2021) Protecting Gender and Identity with Disentangled Speech Representations. Proc. Interspeech 2021, 1699-1703, doi: 10.21437/Interspeech.2021-2163

  author={Dimitrios Stoidis and Andrea Cavallaro},
  title={{Protecting Gender and Identity with Disentangled Speech Representations}},
  booktitle={Proc. Interspeech 2021},