Search Results for author: Ankur Kumar

Found 4 papers, 0 papers with code

Vision Transformer Compression with Structured Pruning and Low Rank Approximation

no code implementations25 Mar 2022 Ankur Kumar

We propose a hybrid compression approach to mitigate this where we compress the attention blocks using low rank approximation and use the previously mentioned pruning with a lower rate for feedforward blocks in each transformer layer.

AI and conventional methods for UCT projection data estimation

no code implementations17 Aug 2021 Ankur Kumar, Prasunika Khare, Mayank Goswami

Other performance indices show that FFT method is processing the UCT signal with best recovery.


A review of on-device fully neural end-to-end automatic speech recognition algorithms

no code implementations14 Dec 2020 Chanwoo Kim, Dhananjaya Gowda, Dongsoo Lee, Jiyeon Kim, Ankur Kumar, Sungsoo Kim, Abhinav Garg, Changwoo Han

Conventional speech recognition systems comprise a large number of discrete components such as an acoustic model, a language model, a pronunciation model, a text-normalizer, an inverse-text normalizer, a decoder based on a Weighted Finite State Transducer (WFST), and so on.

Automatic Speech Recognition speech-recognition

Improved Multi-Stage Training of Online Attention-based Encoder-Decoder Models

no code implementations28 Dec 2019 Abhinav Garg, Dhananjaya Gowda, Ankur Kumar, Kwangyoun Kim, Mehul Kumar, Chanwoo Kim

In this paper, we propose a refined multi-stage multi-task training strategy to improve the performance of online attention-based encoder-decoder (AED) models.

Language Modelling Multi-Task Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.