no code implementations • NIPS Workshop CDNNRIA 2018 • Animesh Koratana*, Daniel Kang*, Peter Bailis, Matei Zahaira
Hint training (i. e., FitNets) extends KD by regressing a student model’s intermediate representation (IR) to a teacher model’s IR.
Knowledge Distillation Model Compression