 |
ESCA - NATO/RSG 10 Workshop on
|
 |
|
ESCA - NATO/RSG 10 Workshop on
|
|
The design of user friendly Interactive Voice Response and Audiotex systems that employ speech recognition for navigating through the menu requires that the menu structure is optimised with respect to the expected performance of the recogniser. To help us find the optimal menu structure, we have developed and implemented a tool that computes several global as well as local diagnostic measures for the combination of the menu tree and the recogniser's performance. In this paper we first explain the background of our work. Then we proceed to present and describe the Figure Of Merit that was developed and the tool that was built to implement it. The Figure Of Merit takes into account the proportion of calls in which no recognition errors occur, the proportion of calls that are successful, and the expected number of extra dialogue pairs in successful calls containing recognition errors. Moreover, the dialogue nodes that are most likely to cause errors are displayed. The paper ends with a short account of our first experience in using the Figure Of Merit and its attendant tools.
Bibliographic reference. Boogaart, Tineke / Alphen, Paul van / Doll, Jeroen (1993): "Application oriented assessment of dialogue systems", In AST-1993, 61-64.