14thAnnual Conference of the International Speech Communication Association

Lyon, France
August 25-29, 2013

Detection of Nonverbal Vocalizations Using Gaussian Mixture Models: Looking for Fillers and Laughter in Conversational Speech

Teun F. Krikke, Khiet P. Truong

University of Twente, The Netherlands

In this paper, we analyze acoustic profiles of fillers (i.e. filled pauses, FPs) and laughter with the aim to automatically localize these nonverbal vocalizations in a stream of audio. Among other features, we use voice quality features to capture the distinctive production modes of laughter and spectral similarity measures to capture the stability of the oral tract that is characteristic for FPs. Classification experiments with Gaussian Mixture Models and various sets of features are performed. We find that Mel-Frequency Cepstrum Coefficients are performing relatively well in comparison to other features for both FPs and laughter. In order to address the large variation in the frame-wise decision scores (e.g., log-likelihood ratios) observed in sequences of frames we apply a median filter to these scores, which yields large performance improvements. Our analyses and results are presented within the framework of this year's Interspeech Computational Paralinguistics sub-Challenge on Social Signals.

Full Paper

Bibliographic reference.  Krikke, Teun F. / Truong, Khiet P. (2013): "Detection of nonverbal vocalizations using Gaussian mixture models: looking for fillers and laughter in conversational speech", In INTERSPEECH-2013, 163-167.