A Study of Enhancement, Augmentation and Autoencoder Methods for Domain Adaptation in Distant Speech Recognition

Hao Tang, Wei-Ning Hsu, Fran├žois Grondin, James Glass


Speech recognizers trained on close-talking speech do not generalize to distant speech and the word error rate degradation can be as large as 40% absolute. Most studies focus on tackling distant speech recognition as a separate problem, leaving little effort to adapting close-talking speech recognizers to distant speech. In this work, we review several approaches from a domain adaptation perspective. These approaches, including speech enhancement, multi-condition training, data augmentation and autoencoders, all involve a transformation of the data between domains. We conduct experiments on the AMI data set, where these approaches can be realized under the same controlled setting. These approaches lead to different amounts of improvement under their respective assumptions. The purpose of this paper is to quantify and characterize the performance gap between the two domains, setting up the basis for studying adaptation of speech recognizers from close-talking speech to distant speech. Our results also have implications for improving distant speech recognition.


 DOI: 10.21437/Interspeech.2018-2030

Cite as: Tang, H., Hsu, W., Grondin, F., Glass, J. (2018) A Study of Enhancement, Augmentation and Autoencoder Methods for Domain Adaptation in Distant Speech Recognition. Proc. Interspeech 2018, 2928-2932, DOI: 10.21437/Interspeech.2018-2030.


@inproceedings{Tang2018,
  author={Hao Tang and Wei-Ning Hsu and Fran├žois Grondin and James Glass},
  title={A Study of Enhancement, Augmentation and Autoencoder Methods for Domain Adaptation in Distant Speech Recognition},
  year=2018,
  booktitle={Proc. Interspeech 2018},
  pages={2928--2932},
  doi={10.21437/Interspeech.2018-2030},
  url={http://dx.doi.org/10.21437/Interspeech.2018-2030}
}