Few-Shot Learning of Compact Models via Task-Specific Meta Distillation

no code implementations • 18 Oct 2022 • Yong Wu, Shekhor Chanda, Mehrdad Hosseinzadeh, Zhi Liu, Yang Wang

In this paper, we propose task-specific meta distillation that simultaneously learns two models in meta-learning: a large teacher model and a small student model.

Few-Shot Image Classification Few-Shot Learning