Generalized Supervised Contrastive Learning

no code implementations • 1 Jun 2022 • Jaewon Kim, Hyukjong Lee, Jooyoung Chang, Sang Min Park

When applied to ResNet50 with the Momentum Contrast technique, GenSCL achieves a top-1 accuracy of 77. 3% on ImageNet, a 4. 1% relative improvement over traditional supervised contrastive learning.

Contrastive Learning Knowledge Distillation +2