Search Results for author: Alina Kolesnikova

Found 1 papers, 1 papers with code

Knowledge Distillation of Russian Language Models with Reduction of Vocabulary

1 code implementation4 May 2022 Alina Kolesnikova, Yuri Kuratov, Vasily Konovalov, Mikhail Burtsev

We propose two simple yet effective alignment techniques to make knowledge distillation to the students with reduced vocabulary.

Knowledge Distillation

Cannot find the paper you are looking for? You can Submit a new open access paper.