11th Annual Conference of the International Speech Communication Association

Makuhari, Chiba, Japan
September 26-30. 2010

A Hybrid Architecture for Mobile Voice User Interfaces

Imre Kiss (1), Joseph Polifroni (1), Chao Wang (2), Ghinwa Choueiter (2), Mike Phillips (2)

(1) Nokia Research Center, USA
(2) Vlingo Corporation, USA

This paper describes our initial experiments with a hybrid voice recognition architecture for mobile voice user interfaces. Our system consists of a large vocabulary continuous speech recognizer on the network side, and a compact embedded recognizer on the handset. The two components are seamlessly integrated to provide a uniform user experience at all times. The hybrid system is able to handle unconstrained voice input from the user at any time, while it also features significantly improved response times and availability of service when compared to a network-only configuration. We have tested the hybrid architecture in an experimental setup with real user data in six different languages. Our results show that depending on the availability of prior usage information from the users, 28-55% of voice queries can be handled locally, with virtually instantaneous recognition, at the cost of less than 5% relative increase in the overall word error-rate of the system.

Full Paper

Bibliographic reference.  Kiss, Imre / Polifroni, Joseph / Wang, Chao / Choueiter, Ghinwa / Phillips, Mike (2010): "A hybrid architecture for mobile voice user interfaces", In INTERSPEECH-2010, 1329-1332.