EUROSPEECH 2001 Scandinavia
7th European Conference on Speech Communication and Technology
2nd INTERSPEECH Event

Aalborg, Denmark
September 3-7, 2001

                  

XISL: An Attempt to Separate Multimodal Interactions from XML Contents

Tsuneo Nitta, Kouichi Katsurada, Hirobumi Yamada, Yusaku Nakamura, Satoshi Kobayashi

Toyohashi University of Technology, Japan

In this paper we outline a multimodal interaction description language XISL (Extensible Interaction-Sheet Language) that is developed to describe multimodal interactions (MMI), and to separate the description of interactions from XML contents. XISL makes an XML document independent of interactions that may differ between each terminal, and so enables such seamless services as web-browsing to be constructed easily. Since XISL also provides various combinatorial usage of modalities, a developer can describe a MMI scenario easily. We implemented an interpreter of XISL on prototype systems for multimedia lectures with different types of MMI and proved the viability of XISL by experiments using the systems.

Full Paper

Bibliographic reference.  Nitta, Tsuneo / Katsurada, Kouichi / Yamada, Hirobumi / Nakamura, Yusaku / Kobayashi, Satoshi (2001): "XISL: an attempt to separate multimodal interactions from XML contents", In EUROSPEECH-2001, 1197-1200.