ISCA Archive Interspeech 2021
ISCA Archive Interspeech 2021

Uncertainty-Aware COVID-19 Detection from Imbalanced Sound Data

Tong Xia, Jing Han, Lorena Qendro, Ting Dang, Cecilia Mascolo

Recently, sound-based COVID-19 detection studies have shown great promise to achieve scalable and prompt digital pre-screening. However, there are still two unsolved issues hindering the practice. First, collected datasets for model training are often imbalanced, with a considerably smaller proportion of users tested positive, making it harder to learn representative and robust features. Second, deep learning models are generally overconfident in their predictions. Clinically, false predictions aggravate healthcare costs. Estimation of the uncertainty of screening would aid this. To handle these issues, we propose an ensemble framework where multiple deep learning models for sound-based COVID-19 detection are developed from different but balanced subsets from original data. As such, data are utilized more effectively compared to traditional up-sampling and down-sampling approaches: an AUC of 0.74 with a sensitivity of 0.68 and a specificity of 0.69 is achieved. Simultaneously, we estimate uncertainty from the disagreement across multiple models. It is shown that false predictions often yield higher uncertainty, enabling us to suggest the users with certainty higher than a threshold to repeat the audio test on their phones or to take clinical tests if digital diagnosis still fails. This study paves the way for a more robust sound-based COVID-19 automated screening system.


doi: 10.21437/Interspeech.2021-1320

Cite as: Xia, T., Han, J., Qendro, L., Dang, T., Mascolo, C. (2021) Uncertainty-Aware COVID-19 Detection from Imbalanced Sound Data. Proc. Interspeech 2021, 2951-2955, doi: 10.21437/Interspeech.2021-1320

@inproceedings{xia21_interspeech,
  author={Tong Xia and Jing Han and Lorena Qendro and Ting Dang and Cecilia Mascolo},
  title={{Uncertainty-Aware COVID-19 Detection from Imbalanced Sound Data}},
  year=2021,
  booktitle={Proc. Interspeech 2021},
  pages={2951--2955},
  doi={10.21437/Interspeech.2021-1320}
}