RelationNet2: Deep Comparison Columns for Few-Shot Learning

17 Nov 2018  ·  Xueting Zhang, Yu-ting Qiang, Flood Sung, Yongxin Yang, Timothy M. Hospedales ·

Few-shot deep learning is a topical challenge area for scaling visual recognition to open ended growth of unseen new classes with limited labeled examples. A promising approach is based on metric learning, which trains a deep embedding to support image similarity matching. Our insight is that effective general purpose matching requires non-linear comparison of features at multiple abstraction levels. We thus propose a new deep comparison network comprised of embedding and relation modules that learn multiple non-linear distance metrics based on different levels of features simultaneously. Furthermore, to reduce over-fitting and enable the use of deeper embeddings, we represent images as distributions rather than vectors via learning parameterized Gaussian noise regularization. The resulting network achieves excellent performance on both miniImageNet and tieredImageNet.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Few-Shot Image Classification Mini-Imagenet 20-way (1-shot) Deep Comparison Network Accuracy 32.07 # 2
Few-Shot Image Classification Mini-Imagenet 20-way (5-shot) Deep Comparison Network Accuracy 47.31 # 2
Few-Shot Image Classification Mini-Imagenet 5-way (1-shot) Deep Comparison Network Accuracy 62.88 # 59
Few-Shot Image Classification Mini-Imagenet 5-way (5-shot) Deep Comparison Network Accuracy 75.84 # 62
Few-Shot Image Classification Tiered ImageNet 5-way (1-shot) Deep Comparison Network Accuracy 68.83 # 35
Few-Shot Image Classification Tiered ImageNet 5-way (5-shot) Deep Comparison Network Accuracy 79.62 # 44

Methods


No methods listed for this paper. Add relevant methods here