ISCA Archive ICSLP 2000
ISCA Archive ICSLP 2000

Preferred modalities in dialogue systems

Vildan Bilici, Emiel Krahmer, Saskia te Riele, Raymond Veldhuis

This research describes which modalities are preferred in particular contexts when interacting with a multi-modal dialogue system. The trade-off between three factors is investigated: (i) speech recognition performance, (ii) efficiency of input modality and (iii) the system’s output modality. Four versions were developed of a multimodal examinator to be used in elementary school. The versions differed in recognition performance (‘perfect’ vs. realistic) and output modality (speech or text). In all systems, subjects could provide input via speaking or typing. Answer length in characters was used as a measure of efficiency. Results show that both speech recognition performance and efficiency have a strong impact on preferred modalities. No effect was found of the system’s output modality.

doi: 10.21437/ICSLP.2000-372

Cite as: Bilici, V., Krahmer, E., Riele, S.t., Veldhuis, R. (2000) Preferred modalities in dialogue systems. Proc. 6th International Conference on Spoken Language Processing (ICSLP 2000), vol. 2, 727-730, doi: 10.21437/ICSLP.2000-372

  author={Vildan Bilici and Emiel Krahmer and Saskia te Riele and Raymond Veldhuis},
  title={{Preferred modalities in dialogue systems}},
  booktitle={Proc. 6th International Conference on Spoken Language Processing (ICSLP 2000)},
  pages={vol. 2, 727-730},