This project aims at creating a multimodal caricatural mirror, where users see and hear their own emotions amplified by an avatar, mimicking the users facial expressions and prosody using a wide screen and loudspeakers. The goal of the project is also to bring together researchers from various fields so as to build a whole system using everyones expertise. The main technical challenges include facial animation, automatic face tracking, automatic vocal and facial features extraction and multimodal emotion recognition and synthesis.
Cite as: Martin, O., Adel, J., Huerta, A., Kotsia, I., Savran, A., Sebbe, R. (2005) Multimodal caricatural mirror. Proc. Summer Workshop on Multimodal Interfaces (eINTERFACE 2005), 13-20
@inproceedings{martin05_einterface, author={Olivier Martin and J. Adel and A. Huerta and Irene Kotsia and Arman Savran and Raphael Sebbe}, title={{Multimodal caricatural mirror}}, year=2005, booktitle={Proc. Summer Workshop on Multimodal Interfaces (eINTERFACE 2005)}, pages={13--20} }