Self-Supervised Learning with an Information Maximization Criterion

1 code implementation • 16 Sep 2022 • Serdar Ozsoy, Shadi Hamdan, Sercan Ö. Arik, Deniz Yuret, Alper T. Erdogan

In this article, we argue that a straightforward application of information maximization among alternative latent representations of the same input naturally solves the collapse problem and achieves competitive empirical results.

Self-Supervised Learning