LumiNet: The Bright Side of Perceptual Knowledge Distillation

1 code implementation • 5 Oct 2023 • Md. Ismail Hossain, M M Lutfe Elahi, Sameera Ramasinghe, Ali Cheraghian, Fuad Rahman, Nabeel Mohammed, Shafin Rahman

In knowledge distillation literature, feature-based methods have dominated due to their ability to effectively tap into extensive teacher models.

Classification Knowledge Distillation +1

COLT: Cyclic Overlapping Lottery Tickets for Faster Pruning of Convolutional Neural Networks

1 code implementation • 24 Dec 2022 • Md. Ismail Hossain, Mohammed Rakib, M. M. Lutfe Elahi, Nabeel Mohammed, Shafin Rahman

This research aims to generate winning lottery tickets from a set of lottery tickets that can achieve similar accuracy to the original unpruned network.

Bangla-Wave: Improving Bangla Automatic Speech Recognition Utilizing N-gram Language Models

no code implementations • 13 Sep 2022 • Mohammed Rakib, Md. Ismail Hossain, Nabeel Mohammed, Fuad Rahman

Although over 300M around the world speak Bangla, scant work has been done in improving Bangla voice-to-text transcription due to Bangla being a low-resource language.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2

LILA-BOTI : Leveraging Isolated Letter Accumulations By Ordering Teacher Insights for Bangla Handwriting Recognition

1 code implementation • 23 May 2022 • Md. Ismail Hossain, Mohammed Rakib, Sabbir Mollah, Fuad Rahman, Nabeel Mohammed

Word-level handwritten optical character recognition (OCR) remains a challenge for morphologically rich languages like Bangla.

Handwriting Recognition Knowledge Distillation +1