Generalized Adaptation for Few-Shot Learning

25 Nov 2019  ·  Liang Song, Jinlu Liu, Yongqiang Qin ·

Many Few-Shot Learning research works have two stages: pre-training base model and adapting to novel model. In this paper, we propose to use closed-form base learner, which constrains the adapting stage with pre-trained base model to get better generalized novel model. Following theoretical analysis proves its rationality as well as indication of how to train a well-generalized base model. We then conduct experiments on four benchmarks and achieve state-of-the-art performance in all cases. Notably, we achieve the accuracy of 87.75% on 5-shot miniImageNet which approximately outperforms existing methods by 10%.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Few-Shot Image Classification CIFAR-FS 5-way (1-shot) ACC + Amphibian Accuracy 73.1 # 30
Few-Shot Image Classification CIFAR-FS 5-way (5-shot) ACC + Amphibian Accuracy 89.3 # 13
Few-Shot Image Classification FC100 5-way (1-shot) ACC + Amphibian Accuracy 41.6 # 18
Few-Shot Image Classification FC100 5-way (5-shot) ACC + Amphibian Accuracy 66.9 # 4
Few-Shot Image Classification Mini-Imagenet 5-way (1-shot) ACC + Amphibian Accuracy 62.21 # 62
Few-Shot Image Classification Mini-Imagenet 5-way (5-shot) ACC + Amphibian Accuracy 80.75 # 44
Few-Shot Image Classification Tiered ImageNet 5-way (1-shot) ACC + Amphibian Accuracy 68.77 # 36
Few-Shot Image Classification Tiered ImageNet 5-way (5-shot) ACC + Amphibian Accuracy 86.75 # 22

Methods


No methods listed for this paper. Add relevant methods here