Search Results for author: Antoine Chassang

Found 1 papers, 1 papers with code

FitNets: Hints for Thin Deep Nets

3 code implementations19 Dec 2014 Adriana Romero, Nicolas Ballas, Samira Ebrahimi Kahou, Antoine Chassang, Carlo Gatta, Yoshua Bengio

In this paper, we extend this idea to allow the training of a student that is deeper and thinner than the teacher, using not only the outputs but also the intermediate representations learned by the teacher as hints to improve the training process and final performance of the student.

Knowledge Distillation

Cannot find the paper you are looking for? You can Submit a new open access paper.