AVSP 2003 - International Conference on Audio-Visual Speech Processing

September 4-7, 2003
St. Jorioz, France

Coproduction of Speech and Emotions: Visual and Acoustic Modifications of Some Phonetic Labial Targets

Emanuela Magno Caldognetto, Piero Cosi, Carlo Drioli, Graziano Tisato, Federica Cavicchio

Laboratory of Phonetics and Dialectology, ISTC-CNR, Institute of Cognitive Sciences and Technology, Italy

This paper concerns the bimodal transmission of emotive speech and describes how the expression of joy, surprise, sadness, disgust, anger, and fear, leads to visual and acoustic target modifications in some Italian phonemes. Current knowledge on the audio-visual transmission of emotive speech traditionally concerns global prosodic and intonational characteristics of speech and facial configurations. In this research we intend to integrate this approach with the analysis of the interaction between labial configurations, peculiar to each emotion, and the articulatory lip movements defined by phonetic-phonological rules, specific to the vowels and consonants /a/, /b/, /v/. Moreover, we present the correlations between articulatory data and the spectral features of the co-produced acoustic signal.

Full Paper

Bibliographic reference.  Magno Caldognetto, Emanuela / Cosi, Piero / Drioli, Carlo / Tisato, Graziano / Cavicchio, Federica (2003): "Coproduction of speech and emotions: visual and acoustic modifications of some phonetic labial targets", In AVSP 2003, 209-214.