8th European Conference on Speech Communication and Technology

Geneva, Switzerland
September 1-4, 2003


Semantic Object Synchronous Understanding in SALT for Highly Interactive User Interface

Kuansan Wang

Microsoft Research, USA

SALT is an industrial standard that enables speech input/ output for Web applications. Although the core design is to make simple tasks easy, SALT gives the designers ample fine-grained controls to create advanced user interface. The paper exploits a speech input mode in which SALT would dynamically report partial semantic parses while audio capturing is still ongoing. The semantic parses can be evaluated and the outcome reported immediately back to the user. The potential impact for the dialog systems is that tasks conventionally performed in a system turn can now be carried out in the midst of a user turn, thereby presenting a significant departure from the conventional turn-taking. To assess the efficacy of such highly interactive interface, more user studies are undoubtedly needed. This paper demonstrates how SALT can be employed to facilitate such studies.

Full Paper

Bibliographic reference.  Wang, Kuansan (2003): "Semantic object synchronous understanding in SALT for highly interactive user interface", In EUROSPEECH-2003, 1209-1212.