DGD: Densifying the Knowledge of Neural Networks with Filter Grafting and Knowledge Distillation

26 Apr 2020Hao ChengFanxu MengKe LiHuixiang LuoGuangming LuXiaowei GuoFeiyue HuangXing Sun

With a fixed model structure, knowledge distillation and filter grafting are two effective ways to boost single model accuracy. However, the working mechanism and the differences between distillation and grafting have not been fully unveiled... (read more)

PDF Abstract

Code


No code implementations yet. Submit your code now

Tasks


Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods used in the Paper


METHOD TYPE
🤖 No Methods Found Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet