This paper proposes a new concept for the design of multimodal user interfaces (MMUIs) based on so-called Multimodal Objects (MMOs). MMOs are a new kind of multimodal components we propose in order to simplify the construction of consistant MMUIs. An MMO is in the simplest case a basic interaction element like a single multimodal button or textfield. These MMOs are built according to the model-view-controller pattern. The model of the MMO is responsible for the logic of the MMO. The view of the MMO has different aspects, one for each modality. The controller of the MMO is responsible for the event fusion, i.e. to coordinate the different events coming from the different aspects of the view and compiling them into a semantic event of the MMO. This semantic event is then transmitted to the model of the MMO which normally results in a state change of the model.
Cite as: Hutter, H.-P., Tönz, R. (2005) New concept for designing multimodal user interfaces. Proc. Applied Spoken Language Interaction in Distributed Environments (ASIDE 2005), paper 25
@inproceedings{hutter05_aside,
author={Hans-Peter Hutter and Roger Tönz},
title={{New concept for designing multimodal user interfaces}},
year=2005,
booktitle={Proc. Applied Spoken Language Interaction in Distributed Environments (ASIDE 2005)},
pages={paper 25}
}