Laughter Valence Prediction in Motivational Interviewing Based on Lexical and Acoustic Cues

Rahul Gupta, Nishant Nath, Taruna Agrawal, Panayiotis Georgiou, David C. Atkins, Shrikanth S. Narayanan


Motivational Interviewing (MI) is a goal oriented psychotherapy counseling that aims to instill positive change in a client through discussion. Since the discourse is in the form of semi-structured natural conversation, it often involves a variety of non-verbal social and affective behaviors such as laughter. Laughter carries information related to affect, mood and personality and can offer a window into the mental state of a person. In this work, we conduct an analytical study on predicting the valence of laughters (positive, neutral or negative) based on lexical and acoustic cues, within the context of MI. We hypothesize that the valence of laughter can be predicted using a window of past and future context around the laughter and, design models to incorporate context, from both text and audio. Through these experiments we validate the relation of the two modalities to perceived laughter valence. Based on the outputs of the prediction experiment, we perform a follow up analysis of the results including: (i) identification of the optimal past and future context in the audio and lexical channels, (ii) investigation of the differences in the prediction patterns for the counselor and the client and, (iii) analysis of feature patterns across the two modalities.


DOI: 10.21437/Interspeech.2016-184

Cite as

Gupta, R., Nath, N., Agrawal, T., Georgiou, P., Atkins, D.C., Narayanan, S.S. (2016) Laughter Valence Prediction in Motivational Interviewing Based on Lexical and Acoustic Cues. Proc. Interspeech 2016, 505-509.

Bibtex
@inproceedings{Gupta+2016,
author={Rahul Gupta and Nishant Nath and Taruna Agrawal and Panayiotis Georgiou and David C. Atkins and Shrikanth S. Narayanan},
title={Laughter Valence Prediction in Motivational Interviewing Based on Lexical and Acoustic Cues},
year=2016,
booktitle={Interspeech 2016},
doi={10.21437/Interspeech.2016-184},
url={http://dx.doi.org/10.21437/Interspeech.2016-184},
pages={505--509}
}