Knowledge Translation: A New Pathway for Model Compression

1 code implementation • 11 Jan 2024 • Wujie Sun, Defang Chen, Jiawei Chen, Yan Feng, Chun Chen, Can Wang

Deep learning has witnessed significant advancements in recent years at the cost of increasing training, inference, and model storage overhead.

Data Augmentation Model Compression +1

Accelerating Diffusion Sampling with Classifier-based Feature Distillation

1 code implementation • 22 Nov 2022 • Wujie Sun, Defang Chen, Can Wang, Deshi Ye, Yan Feng, Chun Chen

Instead of aligning output images, we distill teacher's sharpened feature distribution into the student with a dataset-independent classifier, making the student focus on those important features to improve performance.