Search Results for author:
Found 3 papers, 2 papers with code
ContraNorm: A Contrastive Learning Perspective on Oversmoothing and Beyond
Instead of characterizing oversmoothing from the view of complete collapse in which representations converge to a single point, we dive into a more general perspective of dimensional collapse in which representations lie in a narrow cone.
Ranked #8 on
Node Property Prediction
on ogbn-arxiv
A Message Passing Perspective on Learning Dynamics of Contrastive Learning
In recent years, contrastive learning achieves impressive results on self-supervised visual representation learning, but there still lacks a rigorous understanding of its learning dynamics.
ArCL: Enhancing Contrastive Learning with Augmentation-Robust Representations
Moreover, we show that contrastive learning fails to learn domain-invariant features, which limits its transferability.
