Accelerator-Aware Training for Transducer-Based Speech Recognition

no code implementations • 12 May 2023 • Suhaila M. Shakiah, Rupak Vignesh Swaminathan, Hieu Duy Nguyen, Raviteja Chinta, Tariq Afzal, Nathan Susanj, Athanasios Mouchtaris, Grant P. Strimel, Ariya Rastrow

Machine learning model weights and activations are represented in full-precision during training.

Quantization speech-recognition +1

Sub-8-bit quantization for on-device speech recognition: a regularization-free approach

no code implementations • 17 Oct 2022 • Kai Zhen, Martin Radfar, Hieu Duy Nguyen, Grant P. Strimel, Nathan Susanj, Athanasios Mouchtaris

For on-device automatic speech recognition (ASR), quantization aware training (QAT) is ubiquitous to achieve the trade-off between model predictive performance and efficiency.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

Sub-8-Bit Quantization Aware Training for 8-Bit Neural Network Accelerator with On-Device Speech Recognition

no code implementations • 30 Jun 2022 • Kai Zhen, Hieu Duy Nguyen, Raviteja Chinta, Nathan Susanj, Athanasios Mouchtaris, Tariq Afzal, Ariya Rastrow

We present a novel sub-8-bit quantization-aware training (S8BQAT) scheme for 8-bit neural network accelerators.

Quantization speech-recognition +1

Sparsification via Compressed Sensing for Automatic Speech Recognition

no code implementations • 9 Feb 2021 • Kai Zhen, Hieu Duy Nguyen, Feng-Ju Chang, Athanasios Mouchtaris, Ariya Rastrow, .

In the literature, such methods are referred to as sparse pruning.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2