1 code implementation • 1 Jan 2021 • Minju Jung, Hyounguk Shon, Eojindl Yi, SungHyun Baek, Junmo Kim
For the pruning and retraining phase, whether the pruned-and-retrained network benefits from the pretrained network indded is examined.
no code implementations • 20 Nov 2022 • Hyungmin Kim, Sungho Suh, SungHyun Baek, Daehwan Kim, Daun Jeong, Hansang Cho, Junmo Kim
Our model not only distills the deterministic and progressive knowledge which are from the pre-trained and previous epoch predictive probabilities but also transfers the knowledge of the deterministic predictive distributions using adversarial learning.