Speech and Language Technology for Disabled Persons

Stockholm, Sweden
May 31 - June 2, 1993

Evaluation of Strategies for Replacing Mouse Action with Speech

M. Zajicek, C. Rose

The Speech Project, School of Computing and Mathematical Sciences, Oxford Brookes University, Oxford, UK

With the increase in the power available in the desktop PC, graphical user interfaces have become available for most applications. Direct graphical manipulation, using a mouse, is a simple and effective form of computer interaction, and makes interfaces more intuitive and easy to use for able bodied people. However people with impaired motor control of their hands find mouse control more difficult than keyboard press. The prolonged mouse press used in click-and-drag actions is especially difficult. For this reason the Speech Project has been involved in a program aimed at finding the best way that mouse control can be replaced with speech. Graphical navigation using speech is notoriously difficult. Given the problems experienced by disabled people with the mouse, an evaluation program was completed. The paper outlines problems with mouse use experienced by our group of disabled students. It then describes the strategies for implementing graphical manipulation using speech. The resulting usability issues are discussed.

Full Paper

Bibliographic reference.  Zajicek, M. / Rose, C. (1993): "Evaluation of strategies for replacing mouse action with speech", In SLTDP-93, 99-102.