Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning

1 code implementation • NeurIPS 2021 • Aakash Kaku, Sahana Upadhya, Narges Razavian

Our analysis reveals that models trained via our approach have higher feature reuse compared to a standard MoCo and learn informative features earlier in the network.

Self-Supervised Learning