Search Results for author: Seungwoo Son

Found 1 papers, 0 papers with code

MaskedKD: Efficient Distillation of Vision Transformers with Masked Images

no code implementations21 Feb 2023 Seungwoo Son, Namhoon Lee, Jaeho Lee

We present MaskedKD, a simple yet effective strategy that can significantly reduce the cost of distilling ViTs without sacrificing the prediction accuracy of the student model.

Knowledge Distillation

Cannot find the paper you are looking for? You can Submit a new open access paper.