This research describes which modalities are preferred in particular contexts when interacting with a multi-modal dialogue system. The trade-off between three factors is investigated: (i) speech recognition performance, (ii) efficiency of input modality and (iii) the systems output modality. Four versions were developed of a multimodal examinator to be used in elementary school. The versions differed in recognition performance (perfect vs. realistic) and output modality (speech or text). In all systems, subjects could provide input via speaking or typing. Answer length in characters was used as a measure of efficiency. Results show that both speech recognition performance and efficiency have a strong impact on preferred modalities. No effect was found of the systems output modality.
Cite as: Bilici, V., Krahmer, E., Riele, S.t., Veldhuis, R. (2000) Preferred modalities in dialogue systems. Proc. 6th International Conference on Spoken Language Processing (ICSLP 2000), vol. 2, 727-730, doi: 10.21437/ICSLP.2000-372
@inproceedings{bilici00_icslp,
author={Vildan Bilici and Emiel Krahmer and Saskia te Riele and Raymond Veldhuis},
title={{Preferred modalities in dialogue systems}},
year=2000,
booktitle={Proc. 6th International Conference on Spoken Language Processing (ICSLP 2000)},
pages={vol. 2, 727-730},
doi={10.21437/ICSLP.2000-372}
}