no code implementations • 27 Mar 2024 • Kaidi Jia, Rongsheng Li
These soft labels provide a similar effect to label smoothing and help prevent the model from becoming over confident and effectively addresses the challenge of data sparsity.
Knowledge Distillation