ISCA Archive Interspeech 2005
ISCA Archive Interspeech 2005

Combination of classifiers for automatic recognition of dialog acts

Pavel Král, Christophe Cerisara, Jana Klecková

This paper deals with automatic dialog acts (DAs) recognition in Czech. The dialog acts are sentence-level labels that represent different states of a dialogue, depending on the application. Our work focuses on two applications: a multimodal reservation system and an animated talking head for hearing-impaired people. In that context, we consider the following DAs: statements, orders, yes/no questions and other questions. We propose to use both lexical and prosodic information for DAs recognition. The main goal of this paper is to compare different methods to combine the results of both classifiers. On a Czech corpus simulating a reservation of train tickets, the lexical information only gives about 92% of classification accuracy, while prosody gives only about 45% of accuracy. When both classifiers are combined with a multilayer perceptron, the lowest (lexical) word error rate further decreases by 26%. We show that this improvement is close to the optimal one, given the correlation of the lexical and prosodic features. The other combination schemes do not outperform the lexical-only results.

doi: 10.21437/Interspeech.2005-384

Cite as: Král, P., Cerisara, C., Klecková, J. (2005) Combination of classifiers for automatic recognition of dialog acts. Proc. Interspeech 2005, 825-828, doi: 10.21437/Interspeech.2005-384

  author={Pavel Král and Christophe Cerisara and Jana Klecková},
  title={{Combination of classifiers for automatic recognition of dialog acts}},
  booktitle={Proc. Interspeech 2005},