The outputs from the teacher network are used as soft labels for supervising the training of a new network.
Ranked #7 on Knowledge Distillation on ImageNet
In this paper, we investigate the bias-variance tradeoff brought by distillation with soft labels.
Single-particle cryo-electron microscopy (cryo-EM) is an emerging imaging modality capable of visualizing proteins and macro-molecular complexes at near-atomic resolution.
Single-particle cryo-Electron Microscopy (EM) has become a popular technique for determining the structure of challenging biomolecules that are inaccessible to other technologies.