Sixth International Conference on Spoken Language Processing
(ICSLP 2000)

Beijing, China
October 16-20, 2000

Preferred Modalities in Dialogue Systems

Vildan Bilici, Emiel Krahmer, Saskia te Riele, Raymond Veldhuis

IPO, Center for User-System Interaction, Technische Universiteit Eindhoven, The Netherlands

This research describes which modalities are preferred in particular contexts when interacting with a multi-modal dialogue system. The trade-off between three factors is investigated: (i) speech recognition performance, (ii) efficiency of input modality and (iii) the system’s output modality. Four versions were developed of a multimodal examinator to be used in elementary school. The versions differed in recognition performance (‘perfect’ vs. realistic) and output modality (speech or text). In all systems, subjects could provide input via speaking or typing. Answer length in characters was used as a measure of efficiency. Results show that both speech recognition performance and efficiency have a strong impact on preferred modalities. No effect was found of the system’s output modality.

Full Paper

Bibliographic reference.  Bilici, Vildan / Krahmer, Emiel / Riele, Saskia te / Veldhuis, Raymond (2000): "Preferred modalities in dialogue systems", In ICSLP-2000, vol.2, 727-730.