EASY: Ensemble Augmented-Shot Y-shaped Learning: State-Of-The-Art Few-Shot Classification with Simple Ingredients

Few-shot learning aims at leveraging knowledge learned by one or more deep learning models, in order to obtain good classification performance on new problems, where only a few labeled samples per class are available. Recent years have seen a fair number of works in the field, introducing methods with numerous ingredients. A frequent problem, though, is the use of suboptimally trained models to extract knowledge, leading to interrogations on whether proposed approaches bring gains compared to using better initial models without the introduced ingredients. In this work, we propose a simple methodology, that reaches or even beats state of the art performance on multiple standardized benchmarks of the field, while adding almost no hyperparameters or parameters to those used for training the initial deep learning models on the generic dataset. This methodology offers a new baseline on which to propose (and fairly compare) new techniques or adapt existing ones.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Few-Shot Image Classification CIFAR-FS 5-way (1-shot) EASY 2xResNet12 1/√2 (transductive) Accuracy 86.99 # 8
Few-Shot Image Classification CIFAR-FS 5-way (1-shot) EASY 3xResNet12 (transductive) Accuracy 87.16 # 7
Few-Shot Image Classification CIFAR-FS 5-way (1-shot) EASY 3xResNet12 (inductive) Accuracy 76.2 # 21
Few-Shot Image Classification CIFAR-FS 5-way (1-shot) EASY 2xResNet12 1/√2 (inductive) Accuracy 75.24 # 24
Few-Shot Image Classification CIFAR-FS 5-way (5-shot) EASY 3xResNet12 (transductive) Accuracy 90.47 # 10
Few-Shot Image Classification CIFAR-FS 5-way (5-shot) EASY 2xResNet12 1/√2 (transductive) Accuracy 90.2 # 11
Few-Shot Image Classification CIFAR-FS 5-way (5-shot) EASY 2xResNet12 1/√2 (inductive) Accuracy 88.38 # 19
Few-Shot Image Classification CIFAR-FS 5-way (5-shot) EASY 3xResNet12 (inductive) Accuracy 89.0 # 15
Few-Shot Image Classification CUB 200 5-way EASY 3xResNet12 (transductive) Accuracy 93.79 # 1
Few-Shot Image Classification CUB 200 5-way 1-shot EASY 3xResNet12 (transductive) Accuracy 90.56 # 8
Few-Shot Image Classification CUB 200 5-way 1-shot EASY 4xResNet12 (transductive) Accuracy 90.5 # 9
Few-Shot Image Classification CUB 200 5-way 1-shot EASY 3xResNet12 (inductive) Accuracy 78.56 # 20
Few-Shot Image Classification CUB 200 5-way 1-shot EASY 4xResNet12 (inductive) Accuracy 77.97 # 21
Few-Shot Image Classification CUB 200 5-way 5-shot EASY 4xResNet12 (transductive) Accuracy 93.5 # 7
Few-Shot Image Classification CUB 200 5-way 5-shot EASY 3xResNet12 (inductive) Accuracy 91.93 # 12
Few-Shot Image Classification CUB 200 5-way 5-shot EASY 4xResNet12 (inductive) Accuracy 91.59 # 13
Few-Shot Image Classification FC100 5-way (1-shot) EASY 2xResNet12 1/√2 (inductive) Accuracy 47.94 # 9
Few-Shot Image Classification FC100 5-way (1-shot) EASY 2xResNet12 1/√2 (transductive) Accuracy 54.47 # 2
Few-Shot Image Classification FC100 5-way (1-shot) EASY 3xResNet12 (transductive) Accuracy 54.13 # 3
Few-Shot Image Classification FC100 5-way (1-shot) EASY 3xResNet12 (inductive) Accuracy 48.07 # 8
Few-Shot Image Classification FC100 5-way (5-shot) EASY 3xResNet12 (inductive) Accuracy 64.74 # 9
Few-Shot Image Classification FC100 5-way (5-shot) EASY 3xResNet12 (transductive) Accuracy 66.86 # 5
Few-Shot Image Classification FC100 5-way (5-shot) EASY 2xResNet12 1/√2 (inductive) Accuracy 64.14 # 10
Few-Shot Image Classification FC100 5-way (5-shot) EASY 2xResNet12 1/√2 (transductive) Accuracy 65.82 # 7
Few-Shot Image Classification Mini-Imagenet 5-way (1-shot) EASY 3xResNet12 (inductive) Accuracy 71.75 # 27
Few-Shot Image Classification Mini-Imagenet 5-way (1-shot) EASY 2xResNet12 1/√2 (inductive) Accuracy 70.63 # 30
Few-Shot Image Classification Mini-Imagenet 5-way (1-shot) EASY 2xResNet12 1/√2 (transductive) Accuracy 82.31 # 11
Few-Shot Image Classification Mini-Imagenet 5-way (1-shot) EASY 3xResNet12 (transductive) Accuracy 84.04 # 8
Few-Shot Learning Mini-Imagenet 5-way (1-shot) EASY (transductive) Accuracy 82.75 # 1
Few-Shot Image Classification Mini-Imagenet 5-way (5-shot) EASY 3xResNet12 (transductive) Accuracy 89.14 # 11
Few-Shot Image Classification Mini-Imagenet 5-way (5-shot) EASY 2xResNet12 1/√2 (transductive) Accuracy 88.57 # 14
Few-Shot Image Classification Mini-Imagenet 5-way (5-shot) EASY 2xResNet12 1/√2 (inductive) Accuracy 86.28 # 19
Few-Shot Image Classification Mini-Imagenet 5-way (5-shot) EASY 3xResNet12 (inductive) Accuracy 87.15 # 16
Few-Shot Image Classification Tiered ImageNet 5-way (1-shot) ASY ResNet12 (transductive) Accuracy 83.98 # 8
Few-Shot Image Classification Tiered ImageNet 5-way (1-shot) EASY 3xResNet12 (transductive) Accuracy 84.29 # 6
Few-Shot Image Classification Tiered ImageNet 5-way (1-shot) EASY 3xResNet12 (inductive) Accuracy 74.71 # 19
Few-Shot Image Classification Tiered ImageNet 5-way (1-shot) ASY ResNet12 (ours) Accuracy 74.31 # 21
Few-Shot Image Classification Tiered ImageNet 5-way (5-shot) EASY 3xResNet12 (inductive) Accuracy 88.33 # 15
Few-Shot Image Classification Tiered ImageNet 5-way (5-shot) ASY ResNet12 (inductive) Accuracy 87.86 # 17
Few-Shot Image Classification Tiered ImageNet 5-way (5-shot) EASY 3xResNet12 (transductive) Accuracy 89.76 # 9
Few-Shot Image Classification Tiered ImageNet 5-way (5-shot) ASY ResNet12 (transductive) Accuracy 89.26 # 11

Methods


No methods listed for this paper. Add relevant methods here