Following up on earlier experiments on the cross-cultural and cross-language perception of short audio-visual utterances produced with varying attitudinal expressions, we compare the verbal responses of native speakers of Hindi with those of German and Cantonese-speaking evaluators to stimuli in the latter two languages. We decided to use English for the cross-language evaluation and draw on ratings of valence, arousal and dominance from a study of almost 14,000 lemmas. We converted our pre-existing labels to this reference system and compared them to the responses of the Hindi speakers. We found that the type of attitude, the rater language but also the stimulus language had significant influence on the raters’ responses that differed in at least two of the dimensions. When we calculated correlations within and between rater groups, we found that the speakers of Hindi were better able to replicate the judgments of the other two groups on stimuli in their own languages than the group ignorant of that language. Semantic analysis of responses revealed that attitudes associated with strong negative emotions such as doubt and anger are picked up well by the non-speakers, whereas more complex attitudes, viz. seductiveness and irony are not.
Cite as: Mixdorff, H., Ghosh, D., Rilliard, A., Hönemann, A. (2020) Perception of Audio-visual Expressions in German and Cantonese by Native Speakers of Hindi. Proc. Speech Prosody 2020, 31-35, doi: 10.21437/SpeechProsody.2020-7
@inproceedings{mixdorff20_speechprosody,
author={Hansjörg Mixdorff and Debashis Ghosh and Albert Rilliard and Angelika Hönemann},
title={{Perception of Audio-visual Expressions in German and Cantonese by Native Speakers of Hindi}},
year=2020,
booktitle={Proc. Speech Prosody 2020},
pages={31--35},
doi={10.21437/SpeechProsody.2020-7}
}