14thAnnual Conference of the International Speech Communication Association

Lyon, France
August 25-29, 2013

Knowledge Integration for Improving Performance in LVCSR

Chen-Yu Chiang (1), Sabato Marco Siniscalchi (2), Sin-Horng Chen (3), Chin-Hui Lee (4)

(1) National Taipei University, Taiwan
(2) Università di Enna Kore, Italy
(3) National Chiao Tung University, Taiwan
(4) Georgia Institute of Technology, USA

This paper presents a knowledge integration framework to improve performance in large vocabulary continuous speech recognition. Two types of knowledge sources, manner attribute and prosodic structure, are incorporated. For manner of articulation, six attribute detectors trained with an American English corpus (WSJ0) are utilized to rescore hypothesized phones in word lattices obtained by a baseline ASR system. For the prosodic structure, models trained with an unsupervised joint prosody labeling and modeling (PLM) technique using WSJ0 are used in lattice rescoring. Experimental results on the American English WSJ word recognition task of the Nov92 test set show that the proposed approach significantly outperforms the baseline system that does not use articulatory and prosodic information. The results also demonstrate the effectiveness and usefulness of the PLM technique in constructing prosodic models for American English ASR.

Full Paper

Bibliographic reference.  Chiang, Chen-Yu / Siniscalchi, Sabato Marco / Chen, Sin-Horng / Lee, Chin-Hui (2013): "Knowledge integration for improving performance in LVCSR", In INTERSPEECH-2013, 1786-1790.