TiCo: Transformation Invariance and Covariance Contrast for Self-Supervised Visual Representation Learning

2 code implementations • 21 Jun 2022 • Jiachen Zhu, Rafael M. Moraes, Serkan Karakulak, Vlad Sobol, Alfredo Canziani, Yann Lecun

Similar to other recent self-supervised learning methods, our method is based on maximizing the agreement among embeddings of different distorted versions of the same image, which pushes the encoder to produce transformation invariant representations.

Representation Learning Self-Supervised Learning