Sixth International Conference on Spoken Language Processing
(ICSLP 2000)

Beijing, China
October 16-20, 2000

MiPaD: A Next Generation PDA Prototype

Xuedong Huang, Alex Acero, C. Chelba, Li Deng, D. Duchene, Joshua Goodman, Hsiao-Wen Hon, D. Jacoby, L. Jiang, R. Loynd, M. Mahajan, P. Mau, S. Meredith, S. Mughal, S. Neto, M. Plumpe, Kuansan Wang, Y. Wang

Speech Technology Group, Microsoft Research, Redmond, WA, USA

MiPad is one of the application prototypes in a project codenamed Dr Who. As a wireless Personal Digital Assistant (PDA), MiPad fully integrates continuous speech recognition (CSR) and spoken language understanding (SLU) to enable users to accomplish many common tasks using a multimodal interface and wireless technologies. It tries to solve the problem of pecking with tiny styluses or typing on minuscule keyboards in todayís PDAs or smart phones. It also avoids the problem of being a cellular telephone that depends on speech-only interaction. MiPad incorporates a built-in microphone that activates whenever a field is selected. As a user taps the screen or uses a built-in roller to navigate, the tapping action narrows the number of possible instructions for spoken language processing. MiPad currently runs on a Windows CE Pocket PC with a Windows 2000 Server where speech recognition is performed. The Dr Who CSR engine has a 64k word vocabulary with a unified context-free grammar and ngram language model. The Dr Who SLU engine is based on a robust chart parser and a plan-based dialog manager. This paper discusses MiPadís design, implementation work in progress, and preliminary user study in comparison to the existing pen-based PDA interface.


Full Paper

Bibliographic reference.  Huang, Xuedong / Acero, Alex / Chelba, C. / Deng, Li / Duchene, D. / Goodman, Joshua / Hon, Hsiao-Wen / Jacoby, D. / Jiang, L. / Loynd, R. / Mahajan, M. / Mau, P. / Meredith, S. / Mughal, S. / Neto, S. / Plumpe, M. / Wang, Kuansan / Wang, Y. (2000): "Mipad: a next generation PDA prototype", In ICSLP-2000, vol.3, 33-36.