ISCA Archive Interspeech 2021
ISCA Archive Interspeech 2021

LACOPE: Latency-Constrained Pitch Estimation for Speech Enhancement

Hendrik Schröter, Tobias Rosenkranz, Alberto N. Escalante-B, Andreas Maier

Fundamental frequency (f0) estimation, also known as pitch tracking, has been a long-standing research topic in the speech and signal processing community. Many pitch estimation algorithms, however, fail in noisy conditions or introduce large delays due to their frame size or Viterbi decoding.

In this study, we propose a deep learning-based pitch estimation algorithm, LACOPE, which was trained in a joint pitch estimation and speech enhancement framework. In contrast to previous work, this algorithm allows for a configurable latency down to an algorithmic delay of 0. This is achieved by exploiting the smoothness properties of the pitch trajectory. That is, a recurrent neural network compensates delay introduced by the feature computation by predicting the pitch for a desired point, allowing a trade-off between pitch accuracy and latency.

We integrate the pitch estimation in a speech enhancement framework for hearing aids. For this application, we allow a delay on the analysis side of approx. 5ms. The pitch estimate is then used for constructing a comb filter in frequency domain as post-processing step to remove intra-harmonic noise.

Our pitch estimation performance is on par with SOTA algorithms like PYIN or CREPE for spoken speech in all noise conditions while introducing minimal latency.


doi: 10.21437/Interspeech.2021-633

Cite as: Schröter, H., Rosenkranz, T., Escalante-B, A.N., Maier, A. (2021) LACOPE: Latency-Constrained Pitch Estimation for Speech Enhancement. Proc. Interspeech 2021, 656-660, doi: 10.21437/Interspeech.2021-633

@inproceedings{schroter21_interspeech,
  author={Hendrik Schröter and Tobias Rosenkranz and Alberto N. Escalante-B and Andreas Maier},
  title={{LACOPE: Latency-Constrained Pitch Estimation for Speech Enhancement}},
  year=2021,
  booktitle={Proc. Interspeech 2021},
  pages={656--660},
  doi={10.21437/Interspeech.2021-633}
}