Third Workshop on Spoken Language Technologies for Under-resourced Languages
Cape Town, South Africa
This paper describes the integration of language identification (LID) into a multilingual automatic speech recognition (ASR) system for spoken conversations containing code-switches between Mandarin and English. We apply a multistream approach to combine at frame level the acoustic model score and the language information, where the latter is provided by an LID component. Furthermore, we advance this multistream approach by a new method called Language Lookahead, in which the language information of subsequent frames is used to improve accuracy. Both methods are evaluated using a set of controlled LID results with varying frame accuracies. Our results show that both approaches improve the ASR performance by at least 4% relative if the LID achieves a minimum frame accuracy of 85%.
Index Terms: code-switching, multi-stream combination, language lookahead
Bibliographic reference. Weiner, Jochen / Vu, Ngoc Thang / Telaar, Dominic / Metze, Florian / Schultz, Tanja / Lyu, Dau-Cheng / Chng, Eng-Siong / Li, Haizhou (2012): "Integration of language identification into a recognition system for spoken conversations containing code-Switches", In SLTU-2012, 76-79.