This paper analyzes acoustic and visual features for affective audio-visual speech based on PAD (Pleasure-ArousalDominance) emotion space. The selected acoustic features include F0 maximum, F0 minimum, duration and energy. A set of Partial Expression Parameters (PEP) is proposed as visual features to describe affective facial movement on talking face. This paper explores the connection between PAD emotion space and acoustic/visual features respectively. The variation of acoustic features is predicted by PAD values, and a PAD-PEP mapping function for facial expression synthesis is built. Experimental result shows that PAD could be properly applied in describing emotional state as well as predicting the acoustic/visual features for affective audiovisual speech synthesis. Index Terms: emotion, acoustic features, facial expression, talking face, speech synthesis
Cite as: Zhang, S., Xu, Y.-J., Jia, J., Cai, L.-H. (2008) Analysis and Modeling of Affective Audio Visual Speech Based on Pad Emotion Space. Proc. International Symposium on Chinese Spoken Language Processing, 281-284
@inproceedings{zhang08d_iscslp,
author={Shen Zhang and Ying-Jin Xu and Jia Jia and Lian-Hong Cai},
title={{Analysis and Modeling of Affective Audio Visual Speech Based on Pad Emotion Space}},
year=2008,
booktitle={Proc. International Symposium on Chinese Spoken Language Processing},
pages={281--284}
}