16th Annual Conference of the International Speech Communication Association

Dresden, Germany
September 6-10, 2015

Structured Output Layer with Auxiliary Targets for Context-Dependent Acoustic Modelling

Pawel Swietojanski, Peter Bell, Steve Renals

University of Edinburgh, UK

In previous work we have introduced a multi-task training technique for neural network acoustic modelling, in which context-dependent and context-independent targets are jointly learned. In this paper, we extend the approach by structuring the output layer such that the context-dependent outputs are dependent on the context-independent outputs, thus using the context-independent predictions at run-time. We have also investigated the applicability of this idea to unsupervised speaker adaptation as an approach to overcome the data sparsity issues that comes to the fore when estimating systems with a large number of context-dependent states, when data is limited. We have experimented with various amounts of training material (from 10 to 300 hours) and find the proposed techniques are particularly well suited to data-constrained conditions allowing to better utilise large context-dependent state-clustered trees. Experimental results are reported for large vocabulary speech recognition using the Switchboard and TED corpora.

Full Paper

Bibliographic reference.  Swietojanski, Pawel / Bell, Peter / Renals, Steve (2015): "Structured output layer with auxiliary targets for context-dependent acoustic modelling", In INTERSPEECH-2015, 3605-3609.