ESCA Workshop on Audio-Visual Speech Processing (AVSP'97) September 26-27, 1997 Rhodes, Greece

Micro- and Macro-Bimodality

Emanuela Magno Caldognetto (1), Isabella Poggi (2)

(1) Centro di Studio per le Ricerche di Fonetica del CNR, Padova, Italy
(2) University Roma 3, Dipartimento di Scienza del linguaggio, Roma, Italy

In audio-visual communication, acoustic and optical modalities are simultaneously at work and their respective signals are intertwined in complex ways. Two kinds of bimodality are distinguished: micro-bimodality and macro-bimodality, the relationship of these optical and acoustic signals with the optical signals performed by hand gestures, facial expression and body movements. Some differences and similarities are described between the two kinds of bimodality on the production and perception side, and a model of context is proposed to account for how acoustic and optical modalities are arranged in the planning and understanding of bimodal communication.

Full Paper

Bibliographic reference.  Magno Caldognetto, Emanuela / Poggi, Isabella (1997): "Micro- and macro-bimodality", In AVSP-1997, 33-36.