S4L: Self-Supervised Semi-Supervised Learning

This work tackles the problem of semi-supervised learning of image classifiers. Our main insight is that the field of semi-supervised learning can benefit from the quickly advancing field of self-supervised visual representation learning... (read more)

PDF Abstract ICCV 2019 PDF ICCV 2019 Abstract
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Semi-Supervised Image Classification ImageNet - 10% labeled data VAT + Entropy Minimization (ResNet-50) Top 5 Accuracy 83.39% # 20
Semi-Supervised Image Classification ImageNet - 10% labeled data Rotation Fine-tuned (ResNet-50) Top 5 Accuracy 78.53% # 25
Semi-Supervised Image Classification ImageNet - 10% labeled data Pseudolabeling (ResNet-50) Top 5 Accuracy 82.41% # 22
Semi-Supervised Image Classification ImageNet - 10% labeled data Exemplar (joint training) Top 5 Accuracy 83.72% # 18
Semi-Supervised Image Classification ImageNet - 10% labeled data VAT + Entropy Minimization Top 5 Accuracy 83.39% # 20
Semi-Supervised Image Classification ImageNet - 10% labeled data VAT Top 5 Accuracy 82.78% # 21
Semi-Supervised Image Classification ImageNet - 10% labeled data Pseudolabeling Top 5 Accuracy 82.41% # 22
Semi-Supervised Image Classification ImageNet - 10% labeled data Exemplar Top 5 Accuracy 81.01% # 23
Semi-Supervised Image Classification ImageNet - 10% labeled data Rotation Top 5 Accuracy 78.53% # 25
Semi-Supervised Image Classification ImageNet - 10% labeled data Exemplar Fine-tuned (ResNet-50) Top 5 Accuracy 81.01% # 23
Semi-Supervised Image Classification ImageNet - 10% labeled data S4L-MOAM (ResNet-50 4×) Top 5 Accuracy 91.23% # 8
Top 1 Accuracy 73.21% # 8
Semi-Supervised Image Classification ImageNet - 10% labeled data S4L-Rotation (ResNet-50) Top 5 Accuracy 83.82% # 16
Semi-Supervised Image Classification ImageNet - 10% labeled data S4L-Exemplar (ResNet-50) Top 5 Accuracy 83.72% # 18
Semi-Supervised Image Classification ImageNet - 10% labeled data VAT (ResNet-50) Top 5 Accuracy 82.78% # 21
Semi-Supervised Image Classification ImageNet - 10% labeled data Rotation + VAT + Ent. Min. Top 5 Accuracy 91.23% # 8
Semi-Supervised Image Classification ImageNet - 1% labeled data Rotation (joint training) Top 5 Accuracy 53.37% # 22
Semi-Supervised Image Classification ImageNet - 1% labeled data Pseudolabeling Top 5 Accuracy 51.56% # 23
Semi-Supervised Image Classification ImageNet - 1% labeled data Exemplar (joint training) Top 5 Accuracy 47.02% # 24
Semi-Supervised Image Classification ImageNet - 1% labeled data VAT + Entropy Minimization Top 5 Accuracy 46.96% # 25
Semi-Supervised Image Classification ImageNet - 1% labeled data Rotation Top 5 Accuracy 45.11% # 26
Semi-Supervised Image Classification ImageNet - 1% labeled data Exemplar Top 5 Accuracy 44.90% # 27
Semi-Supervised Image Classification ImageNet - 1% labeled data VAT Top 5 Accuracy 44.05% # 28

Methods used in the Paper