5th International Conference on Spoken Language Processing

Sydney, Australia
November 30 - December 4, 1998

The Efficiency of Multimodal Interaction: a Case Study

Phil R. Cohen, Michael Johnston, David McGee, Sharon L. Oviatt, Joshua Clow, Ira Smith

Oregon Graduate Institute, USA

This paper reports on a case study comparison of a direct-manipulation-based graphical user interface (GUI) with the QuickSet pen/voice multimodal interface for supporting the task of military force "laydown." In this task, a user places military units and "control measures," such as various types of lines, obstacles, objectives, etc., on a map. A military expert designed his own scenario and entered it via both interfaces. Usage of QuickSet led to a speed improvement of 3.2 to 8.7-fold, depending on the kind of object being created. These results suggest that there may be substantial efficiency advantages to using multimodal interaction over GUIs for map-based tasks.

Full Paper

Bibliographic reference.  Cohen, Phil R. / Johnston, Michael / McGee, David / Oviatt, Sharon L. / Clow, Joshua / Smith, Ira (1998): "The efficiency of multimodal interaction: a case study", In ICSLP-1998, paper 0571.