Jasper: An End-to-End Convolutional Neural Acoustic Model

Jason Li, Vitaly Lavrukhin, Boris Ginsburg, Ryan Leary, Oleksii Kuchaiev, Jonathan M. Cohen, Huyen Nguyen, Ravi Teja Gadde


In this paper we report state-of-the-art results on LibriSpeech among end-to-end speech recognition models without any external training data. Our model, Jasper, uses only 1D convolutions, batch normalization, ReLU, dropout, and residual connections. To improve training, we further introduce a new layer-wise optimizer called NovoGrad. Through experiments, we demonstrate that the proposed deep architecture performs as well or better than more complex choices. Our deepest Jasper variant uses 54 convolutional layers. With this architecture, we achieve 2.95% WER using a beam-search decoder with an external neural language model and 3.86% WER with a greedy decoder on LibriSpeech test-clean. We also report competitive results on Wall Street Journal and the Hub5’00 conversational evaluation datasets.


 DOI: 10.21437/Interspeech.2019-1819

Cite as: Li, J., Lavrukhin, V., Ginsburg, B., Leary, R., Kuchaiev, O., Cohen, J.M., Nguyen, H., Gadde, R.T. (2019) Jasper: An End-to-End Convolutional Neural Acoustic Model. Proc. Interspeech 2019, 71-75, DOI: 10.21437/Interspeech.2019-1819.


@inproceedings{Li2019,
  author={Jason Li and Vitaly Lavrukhin and Boris Ginsburg and Ryan Leary and Oleksii Kuchaiev and Jonathan M. Cohen and Huyen Nguyen and Ravi Teja Gadde},
  title={{Jasper: An End-to-End Convolutional Neural Acoustic Model}},
  year=2019,
  booktitle={Proc. Interspeech 2019},
  pages={71--75},
  doi={10.21437/Interspeech.2019-1819},
  url={http://dx.doi.org/10.21437/Interspeech.2019-1819}
}