This paper describes the principal elements of the oral and tactile GEORAL system, as well as the results of a primary evaluation of the system. Firstly, we present the main dialogue functionalities and the problems due to the multimodal activities. These problems are mainly concerned with the relationships between the linguistic syntagms of oral utterances and the user's activity on the screen (pointing, drawing a zone,...). Then we describe the technical choices we made and the architecture of the system. We decided to give priority to the speech input, and to merge the results of the two activities at the latest possible. Some details both on the data structures (dialogue acts, communicative acts) we use and the processing ways are provided. Finally, we present the first results of an evaluation of the system with unexperimented users. The results show the oral-tactile synergy is well accepted and improve slightly the system understanding.
Bibliographic reference. Siroux, J. / Guyomard, M. / Jolly, Y. / Multon, F. / Remondeau, C. (1995): "Speech and tactile-based georal system", In EUROSPEECH-1995, 1943-1946.