Applied Spoken Language Interaction in Distributed Environments (ASIDE 2005) ITRW and COST278 Final Workshop Aalborg, Denmark November 10-11, 2005

Mobile Architecture for Distributed Multimodal Dialogues

Markku Turunen, Esa-Pekka Salonen, Jaakko Hakulinen, Juuso Kanner, Anssi Kainulainen

Speech-based and Pervasive Interaction Group, Tampere Unit for Computer-Human Interaction, Department of Computer Sciences, University of Tampere, Finland

There is an increasing need for mobile spoken dialogue systems. Mobile devices, such as smartphonesand personal digital assistants, can be used to implement efficient speech-based and multimodal interfaces. Currently, the development of such applications lacks suitable tools. We introduce general system architecture for mobile spoken dialogue systems. The architecture is a mobile version of the existing Jaspis architecture. The architecture makes it possible to implement distributed dialoguesystems using compact software agents in flexible ways both on the server and mobile devices. We present how an existing server-based timetable application is turned into a multimodal mobile application. The server handles the overall coordination of the dialogue by generating dialogue task descriptions using VoiceXML, and the mobile device realizes the dialogue descriptions with available resources.

Full Paper

Bibliographic reference.  Turunen, Markku / Salonen, Esa-Pekka / Hakulinen, Jaakko / Kanner, Juuso / Kainulainen, Anssi (2005): "Mobile architecture for distributed multimodal dialogues", In ASIDE-2005, paper 22.