Vocal Biomarkers for Cognitive Performance Estimation in a Working Memory Task

Jennifer Sloboda, Adam Lammert, James Williamson, Christopher Smalt, Daryush D. Mehta, COL Ian Curry, Kristin Heaton, Jeffrey Palmer, Thomas Quatieri


The ability to non-invasively estimate cognitive fatigue and workload as contributing factors to cognitive performance has value for planning and decision making surrounding human participation in cognitively demanding situations and environments. Growing evidence supports the use of speech as an effective modality for assessing cognitive fatigue and workload, while also being operationally appropriate in a wide variety of environments. To assess ability to discriminate changes in cognitive fatigue and load from speech, features that measure speech onset time, speaking rate, voice quality and vocal tract coordination from the delta-mel-cepstrum are evaluated on two independent data sets that employ the same auditory working memory task. Feature effect sizes due to fatigue were generally larger than those due to load. Speech onset time, speaking rate and vocal tract coordination features show strong potential for speech-based fatigue estimation.


 DOI: 10.21437/Interspeech.2018-2418

Cite as: Sloboda, J., Lammert, A., Williamson, J., Smalt, C., Mehta, D.D., Curry, C.I., Heaton, K., Palmer, J., Quatieri, T. (2018) Vocal Biomarkers for Cognitive Performance Estimation in a Working Memory Task. Proc. Interspeech 2018, 1756-1760, DOI: 10.21437/Interspeech.2018-2418.


@inproceedings{Sloboda2018,
  author={Jennifer Sloboda and Adam Lammert and James Williamson and Christopher Smalt and Daryush D. Mehta and COL Ian Curry and Kristin Heaton and Jeffrey Palmer and Thomas Quatieri},
  title={Vocal Biomarkers for Cognitive Performance Estimation in a Working Memory Task},
  year=2018,
  booktitle={Proc. Interspeech 2018},
  pages={1756--1760},
  doi={10.21437/Interspeech.2018-2418},
  url={http://dx.doi.org/10.21437/Interspeech.2018-2418}
}