ISCA Archive SLTU 2012
ISCA Archive SLTU 2012

Integration of language identification into a recognition system for spoken conversations containing code-Switches

Jochen Weiner, Ngoc Thang Vu, Dominic Telaar, Florian Metze, Tanja Schultz, Dau-Cheng Lyu, Eng-Siong Chng, Haizhou Li

This paper describes the integration of language identification (LID) into a multilingual automatic speech recognition (ASR) system for spoken conversations containing code-switches between Mandarin and English. We apply a multistream approach to combine at frame level the acoustic model score and the language information, where the latter is provided by an LID component. Furthermore, we advance this multistream approach by a new method called “Language Lookahead”, in which the language information of subsequent frames is used to improve accuracy. Both methods are evaluated using a set of controlled LID results with varying frame accuracies. Our results show that both approaches improve the ASR performance by at least 4% relative if the LID achieves a minimum frame accuracy of 85%.

Index Terms: code-switching, multi-stream combination, language lookahead


Cite as: Weiner, J., Vu, N.T., Telaar, D., Metze, F., Schultz, T., Lyu, D.-C., Chng, E.-S., Li, H. (2012) Integration of language identification into a recognition system for spoken conversations containing code-Switches. Proc. 3rd Workshop on Spoken Language Technologies for Under-Resourced Languages (SLTU 2012), 76-79

@inproceedings{weiner12_sltu,
  author={Jochen Weiner and Ngoc Thang Vu and Dominic Telaar and Florian Metze and Tanja Schultz and Dau-Cheng Lyu and Eng-Siong Chng and Haizhou Li},
  title={{Integration of language identification into a recognition system for spoken conversations containing code-Switches}},
  year=2012,
  booktitle={Proc. 3rd Workshop on Spoken Language Technologies for Under-Resourced Languages (SLTU 2012)},
  pages={76--79}
}