Auditory-Visual Speech Processing 2005

British Columbia, Canada
July 24-27, 2005

A Multi-Measurement Approach to the Identification of the Audiovisual Facial Correlates of Contrastive Focus in French

Marion Dohen (1), Hélène Loevenbruck (1), Harold Hill (2)

(1) Institut de la Communication Parlée, Grenoble, France
(2) Human Information Science Research Labs, ATR, Kyoto, Japan

The aims of this study are twofold. We first seek to validate a previous study conducted on one speaker. It identified lower face visible articulatory correlates of contrastive focus in French for real (non-reiterant) speech. We thus conducted the same study for another speaker. Our second goal was to enlarge the set of cues measured to other facial movements. To do so we used a complementary measurement technique (Optotrak) on the same corpus. The articulatory measurements showed that there was a set of consistent visible articulatory correlates of contrastive focus in French across speakers: a) an increase in lip area and jaw opening on the focused item b) a lengthening of the focal syllables c) a post-focal hypo-articulation. However, there are also some speaker specific strategies. The first speaker showed an anticipation strategy but the second speaker did not. The Optotrak measurements confirmed that: a) focus corresponded to an increase in lip height and/or in lip width b) the post-focal sequence was hypo-articulated. We also found that: a) the focused item was often correlated with a slight head movement (nod) b) facial movements such as cheek movements were amplified when there was focus and c) eyebrow movements were not correlated with focus.

Full Paper

Bibliographic reference.  Dohen, Marion / Loevenbruck, Hélène / Hill, Harold (2005): "A multi-measurement approach to the identification of the audiovisual facial correlates of contrastive focus in French", In AVSP-2005, 115-116.