Second VENACO Workshop The Structure of Multimodal Dialogue Acquafredda di Maratea, Italy September 16-20, 1991

Robustness and Cooperative Multimodal Man-Machine Communication Applications

Jean-Claude Junqua

Speech Technology Laboratory, Division of Panasonic, Technologies, Inc., Santa Barbara, CA, USA

From the point of view of our research, robustness in man-machine communication is defined as the "stability in time that it takes (or stable number of trials necessary) to perform a task, under varying conditions, including challenging conditions", such as acoustic variability caused by speaker differences, user stress or fatigue, noise, hesitations, etc. Robustness implies, in particular, reliability, consistency, and user satisfaction. The purpose of multimodal man-machine communication is to take advantage of the possibilities of multiple communication channels to establish a dialogue with a partner which, in the present case, is a computer Most of the past research has been done on unimodal dialogue. However, communication with computers, as it is for humans, should be multimodal.

Full Paper

Bibliographic reference.  Junqua, Jean-Claude (1991): "Robustness and cooperative multimodal man-machine communication applications", In SMMD-1991, 101-112.