no code implementations • 7 Feb 2024 • Rehan Ahmad, Muhammad Umar Farooq, Thomas Hain
A previous study has shown the effectiveness of using ensemble teacher models in T/S training for unsupervised domain adaptation (UDA) but its performance still lags behind compared to the model trained on in-domain data.
Automatic Speech Recognition Automatic Speech Recognition (ASR) +2
no code implementations • 29 Oct 2023 • Muhammad Umar Farooq, Rehan Ahmad, Thomas Hain
However, a limitation of KD training is that the student model classes must be a proper or improper subset of the teacher model classes.
no code implementations • 1 Mar 2023 • Rehan Ahmad, Md Asif Jalal, Muhammad Umar Farooq, Anna Ollerenshaw, Thomas Hain
Knowledge distillation has widely been used for model compression and domain adaptation for speech applications.
no code implementations • 25 Jul 2022 • Chanho Park, Rehan Ahmad, Thomas Hain
By using the submodular function, a training set for automatic speech recognition matching the target data set is selected.
Automatic Speech Recognition Automatic Speech Recognition (ASR) +1