Search Results for author:
Found 5 papers, 0 papers with code
A Treatise On FST Lattice Based MMI Training
Maximum mutual information (MMI) has become one of the two de facto methods for sequence-level training of speech recognition acoustic models.
A Distributed Optimisation Framework Combining Natural Gradient with Hessian-Free for Discriminative Sequence Training
This paper presents a novel natural gradient and Hessian-free (NGHF) optimisation framework for neural network training that can operate efficiently in a distributed manner.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Combining Natural Gradient with Hessian Free Methods for Sequence Training
This paper presents a new optimisation approach to train Deep Neural Networks (DNNs) with discriminative sequence criteria.
Sequence Training of DNN Acoustic Models With Natural Gradient
Deep Neural Network (DNN) acoustic models often use discriminative sequence training that optimises an objective function that better approximates the word error rate (WER) than frame-based training.
A Common Framework for Natural Gradient and Taylor based Optimisation using Manifold Theory
This technical report constructs a theoretical framework to relate standard Taylor approximation based optimisation methods with Natural Gradient (NG), a method which is Fisher efficient with probabilistic models.
