GPU-based Self-Organizing Maps for Post-Labeled Few-Shot Unsupervised Learning

4 Sep 2020  ·  Lyes Khacef, Vincent Gripon, Benoit Miramond ·

Few-shot classification is a challenge in machine learning where the goal is to train a classifier using a very limited number of labeled examples. This scenario is likely to occur frequently in real life, for example when data acquisition or labeling is expensive. In this work, we consider the problem of post-labeled few-shot unsupervised learning, a classification task where representations are learned in an unsupervised fashion, to be later labeled using very few annotated examples. We argue that this problem is very likely to occur on the edge, when the embedded device directly acquires the data, and the expert needed to perform labeling cannot be prompted often. To address this problem, we consider an algorithm consisting of the concatenation of transfer learning with clustering using Self-Organizing Maps (SOMs). We introduce a TensorFlow-based implementation to speed-up the process in multi-core CPUs and GPUs. Finally, we demonstrate the effectiveness of the method using standard off-the-shelf few-shot classification benchmarks.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Few-Shot Image Classification Mini-Imagenet 5-way (1-shot) WRN + Self-Organizing Map Accuracy 71.5 # 29
Few-Shot Image Classification Mini-Imagenet 5-way (5-shot) WRN + Self-Organizing Map Accuracy 82.2 # 37

Methods


No methods listed for this paper. Add relevant methods here