ISCA Archive Interspeech 2008
ISCA Archive Interspeech 2008

Cross-lingual portability of MLP-based tandem features - a case study for English and Hungarian

Lászlá Tóth, Joe Frankel, Gábor Gosztolya, Simon King

One promising approach for building ASR systems for lessresourced languages is cross-lingual adaptation. Tandem ASR is particularly well suited to such adaptation, as it includes two cascaded modelling steps: feature extraction using multi-layer perceptrons (MLPs), followed by modelling using a standard HMM. The language-specific tuning can be performed by adjusting the HMM only, leaving the MLP untouched.

Here we examine the portability of feature extractor MLPs between an Indo-European (English) and a Finno-Ugric (Hungarian) language. We present experiments which use both conventional phone-posterior and articulatory feature (AF) detector MLPs, both trained on a much larger quantity of (English) data than the monolingual (Hungarian) system. We find that the cross-lingual configurations achieve similar performance to the monolingual system, and that, interestingly, the AF detectors lead to slightly worse performance, despite the expectation that they should be more language-independent than phone-based MLPs. However, the cross-lingual system outperforms all other configurations when the English phone MLP is adapted on the Hungarian data.


doi: 10.21437/Interspeech.2008-668

Cite as: Tóth, L., Frankel, J., Gosztolya, G., King, S. (2008) Cross-lingual portability of MLP-based tandem features - a case study for English and Hungarian. Proc. Interspeech 2008, 2695-2698, doi: 10.21437/Interspeech.2008-668

@inproceedings{toth08b_interspeech,
  author={Lászlá Tóth and Joe Frankel and Gábor Gosztolya and Simon King},
  title={{Cross-lingual portability of MLP-based tandem features - a case study for English and Hungarian}},
  year=2008,
  booktitle={Proc. Interspeech 2008},
  pages={2695--2698},
  doi={10.21437/Interspeech.2008-668}
}