Interspeech'2005 - Eurospeech

Lisbon, Portugal
September 4-8, 2005

Comparing HMM, Maximum Entropy, and Conditional Random Fields for Disfluency Detection

Yang Liu (1), Elizabeth Shriberg (2), Andreas Stolcke (2), Mary Harper (3)

(1) International Computer Science Institute, USA; (2) SRI International, USA; (3) Purdue University, USA

Automatic detection of disfluencies in spoken language is important for making speech recognition output more readable, and for aiding downstream language processing modules. We compare a generative hidden Markov model (HMM)-based approach and two conditional models - a maximum entropy (Maxent) model and a conditional random field (CRF) - for detecting disfluencies in speech. The conditional modeling approaches provide a more principled way to model correlated features. In particular, the CRF approach directly detects the reparandum regions, and thus avoids the use of ad-hoc heuristic rules. We evaluate performance of these three models across two different corpora (conversational speech and broadcast news) and for two types of transcriptions (human transcriptions and recognition output). Overall we find that the conditional modeling approaches (Maxent and CRF) tend to outperform (with one exception) the HMM approach. Effects of speaking style, word recognition errors, and future directions are also discussed.

Full Paper

Bibliographic reference.  Liu, Yang / Shriberg, Elizabeth / Stolcke, Andreas / Harper, Mary (2005): "Comparing HMM, maximum entropy, and conditional random fields for disfluency detection", In INTERSPEECH-2005, 3313-3316.