12th Annual Conference of the International Speech Communication Association

Florence, Italy
August 27-31. 2011

mTalk - A Multimodal Browser for Mobile Services

Michael Johnston, Giuseppe Di Fabbrizio, Simon Urbanek

AT&T Labs Research, USA

The mTalk multimodal browser is a tool which enables rapid prototyping for research and development of mobile multimodal interfaces combining natural modalities such as speech, touch, and gesture. mTalk integrates a broad range of open standards for authoring graphical and spoken user interfaces and is supported by a cloud-based multimodal processing architecture. In this paper, we describe mTalk and illustrate its capabilities through examination of a series of sample applications.

Full Paper

Bibliographic reference.  Johnston, Michael / Fabbrizio, Giuseppe Di / Urbanek, Simon (2011): "mtalk - a multimodal browser for mobile services", In INTERSPEECH-2011, 3261-3264.