Search Results for author: Larisa Markeeva

Found 5 papers, 4 papers with code

A Generalized Lottery Ticket Hypothesis

no code implementations3 Jul 2021 Ibrahim Alabdulmohsin, Larisa Markeeva, Daniel Keysers, Ilya Tolstikhin

We introduce a generalization to the lottery ticket hypothesis in which the notion of "sparsity" is relaxed by choosing an arbitrary basis in the space of parameters.

Knowledge distillation: A good teacher is patient and consistent

3 code implementations CVPR 2022 Lucas Beyer, Xiaohua Zhai, Amélie Royer, Larisa Markeeva, Rohan Anil, Alexander Kolesnikov

In particular, we uncover that there are certain implicit design choices, which may drastically affect the effectiveness of distillation.

Knowledge Distillation

Cannot find the paper you are looking for? You can Submit a new open access paper.