A new integration method is presented to recognize the emotional expressions. We attempted to use both voices and facial expressions. For voices, we use such prosodic parameters as pitch signals, energy, and their derivatives, which are trained by Hidden Markov Model (HMM) for recognition. For facial expressions, we use feature parameters from thermal images in addition to visible images, which are trained by neural networks (NN) for recognition. The thermal images are observed by infrared ray which is not influenced by lighting conditions. The total recognition rates show better performance than each performance rate obtained from isolated experiment. The results are compared with the recognition by human questionnaire.
Cite as: Kitazoe, T., Kim, S.-I., Yoshitomi, Y., Ikeda, T. (2000) Recognition of emotional states using voice, face image and thermal image of face. Proc. 6th International Conference on Spoken Language Processing (ICSLP 2000), vol. 1, 653-656, doi: 10.21437/ICSLP.2000-162
@inproceedings{kitazoe00b_icslp,
author={Tetsuro Kitazoe and Sung-Ill Kim and Yasunari Yoshitomi and Tatsuhiko Ikeda},
title={{Recognition of emotional states using voice, face image and thermal image of face}},
year=2000,
booktitle={Proc. 6th International Conference on Spoken Language Processing (ICSLP 2000)},
pages={vol. 1, 653-656},
doi={10.21437/ICSLP.2000-162}
}