FAAVSP - The 1st Joint Conference on Facial Analysis, Animation, and
Auditory-Visual Speech Processing

Vienna, Austria
September 11-13, 2015

The Multi-Modal Nature of Trustworthiness Perception

Elena Tsankova (1), Eva Krumhuber (2), Andrew J. Aubrey (3), Arvid Kappas (1), Guido Möllering (1), David Marshall (3), Paul L. Rosin (3)

(1) Jacobs University Bremen, Germany; (2) University College London, UK: (3) Cardiff University, UK

Most past work on trustworthiness perception has focused on the structural features of the human face. The present study investigates the interplay of dynamic information from two channels – the face and the voice. By systematically varying the level of trustworthiness in each channel, 49 participants were presented with either facial or vocal information, or the combination of both, and made explicit judgements with respect to trustworthiness, dominance, and emotional valence. For most measures results revealed a primacy effect of facial over vocal cues. In examining the exact nature of the trustworthiness - emotion link we further found that emotional valence functioned as a significant mediator in impressions of trustworthiness. The findings extend previous correlational evidence and provide important knowledge of how trustworthiness in its dynamic and multi-modal form is decoded by the human perceiver. Index Terms: trustworthiness, face, voice, emotion, dynamic, multi-modal

Full Paper

Bibliographic reference.  Tsankova, Elena / Krumhuber, Eva / Aubrey, Andrew J. / Kappas, Arvid / Möllering, Guido / Marshall, David / Rosin, Paul L. (2015): "The multi-modal nature of trustworthiness perception", In FAAVSP-2015, 147-152.