10th Annual Conference of the International Speech Communication Association

Brighton, United Kingdom
September 6-10, 2009

A Study on Soft Margin Estimation of Linear Regression Parameters for Speaker Adaptation

Shigeki Matsuda (1), Yu Tsao (1), Jinyu Li (2), Satoshi Nakamura (1), Chin-Hui Lee (3)

(1) NICT, Japan
(2) Microsoft Corporation, USA
(3) Georgia Institute of Technology, USA

We formulate a framework for soft margin estimation-based linear regression (SMELR) and apply it to supervised speaker adaptation. Enhanced separation capability and increased discriminative ability are two key properties in margin-based discriminative training. For the adaptation process to be able to flexibly utilize any amount of data, we also propose a novel interpolation scheme to linearly combine the speaker independent (SI) and speaker adaptive SMELR (SMELR/SA) models. The two proposed SMELR algorithms were evaluated on a Japanese large vocabulary continuous speech recognition task. Both the SMELR and interpolated SI+SMELR/SA techniques showed improved speech adaptation performance in comparison with the well-known maximum likelihood linear regression (MLLR) method. We also found that the interpolation framework works even more effectively than SMELR when the amount of adaptation data is relatively small.

Full Paper

Bibliographic reference.  Matsuda, Shigeki / Tsao, Yu / Li, Jinyu / Nakamura, Satoshi / Lee, Chin-Hui (2009): "A study on soft margin estimation of linear regression parameters for speaker adaptation", In INTERSPEECH-2009, 1603-1606.