Search Results for author:
Found 1 papers, 0 papers with code
Exploring and Enhancing the Transfer of Distribution in Knowledge Distillation for Autoregressive Language Models
Knowledge distillation (KD) is a technique that compresses large teacher models by training smaller student models to mimic them.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
