INTERSPEECH 2015
16th Annual Conference of the International Speech Communication Association

Dresden, Germany
September 6-10, 2015

Automatic Detection of Mild Cognitive Impairment from Spontaneous Speech Using ASR

László Tóth (1), Gábor Gosztolya (1), Veronika Vincze (1), Ildikó Hoffmann (2), Gréta Szatlóczki (2), Edit Biró (2), Fruzsina Zsura (2), Magdolna Pákáski (2), János Kálmán (2)

(1) MTA-SZTE RGAI, Hungary
(2) University of Szeged, Hungary

Mild Cognitive Impairment (MCI), sometimes regarded as a prodromal stage of Alzheimer's disease, is a mental disorder that is difficult to diagnose. However, recent studies reported that MCI causes slight changes in the speech of the patient. Our starting point here is a study that found acoustic correlates of MCI, but extracted the proposed features manually. Here, we automate the extraction of the features by applying automatic speech recognition (ASR). Unlike earlier authors, we use ASR to extract only a phonetic level segmentation and annotation. While the phonetic output allows the calculation of features like the speech rate, it avoids the problems caused by the agrammatical speech frequently produced by the targeted patient group. Furthermore, as hesitation is the most important indicator of MCI, we take special care when handling filled pauses, which usually correspond to hesitation. Using the ASR-based features, we employ machine learning methods to separate the subjects with MCI from the control group. The classification results obtained with ASR-based feature extraction are just slightly worse that those got with the manual method. The F1 value achieved (85.3) is very promising regarding the creation of an automated MCI screening application.

Full Paper

Bibliographic reference.  Tóth, László / Gosztolya, Gábor / Vincze, Veronika / Hoffmann, Ildikó / Szatlóczki, Gréta / Biró, Edit / Zsura, Fruzsina / Pákáski, Magdolna / Kálmán, János (2015): "Automatic detection of mild cognitive impairment from spontaneous speech using ASR", In INTERSPEECH-2015, 2694-2698.