Search Results for author: Zony Yu

Found 1 papers, 0 papers with code

Revisiting Intermediate-Layer Matching in Knowledge Distillation: Layer-Selection Strategy Doesn't Matter (Much)

no code implementations6 Feb 2025 Zony Yu, Yuqiao Wen, Lili Mou

Knowledge distillation (KD) is a popular method of transferring knowledge from a large "teacher" model to a small "student" model.

Knowledge Distillation

Cannot find the paper you are looking for? You can Submit a new open access paper.