On the Usage of Phonetic Information for Text-Independent Speaker Embedding Extraction

Shuai Wang, Johan Rohdin, Lukáš Burget, Oldřich Plchot, Yanmin Qian, Kai Yu, Jan Černocký


Embeddings extracted by deep neural networks have become the state-of-the-art utterance representation in speaker recognition systems. It has recently been shown that incorporating frame-level phonetic information in the embedding extractor can improve the speaker recognition performance. On the other hand, in the final embedding, phonetic information is just an additional source of session variability which may be harmful to the text-independent speaker recognition task. This suggests that at the embedding level phonetic information should be suppressed rather than encouraged. To verify this hypothesis, we perform several experiments that encourage or/and suppress phonetic information at various stages in the network. Our experiments confirm that multitask learning is beneficial if it is applied at the frame-level stage of the network, whereas adversarial training is beneficial if it is used at the segment-level stage of the network. Additionally, the combination of these two approaches improves the performance further, resulting in an equal error rate of 3.17% on the VoxCeleb dataset.


 DOI: 10.21437/Interspeech.2019-3036

Cite as: Wang, S., Rohdin, J., Burget, L., Plchot, O., Qian, Y., Yu, K., Černocký, J. (2019) On the Usage of Phonetic Information for Text-Independent Speaker Embedding Extraction. Proc. Interspeech 2019, 1148-1152, DOI: 10.21437/Interspeech.2019-3036.


@inproceedings{Wang2019,
  author={Shuai Wang and Johan Rohdin and Lukáš Burget and Oldřich Plchot and Yanmin Qian and Kai Yu and Jan Černocký},
  title={{On the Usage of Phonetic Information for Text-Independent Speaker Embedding Extraction}},
  year=2019,
  booktitle={Proc. Interspeech 2019},
  pages={1148--1152},
  doi={10.21437/Interspeech.2019-3036},
  url={http://dx.doi.org/10.21437/Interspeech.2019-3036}
}