no code implementations • 7 Apr 2023 • Yunwei Ren, Yuanzhi Li
Recently, contrastive learning approaches (e. g., CLIP (Radford et al., 2021)) have received huge success in multimodal learning, where the model tries to minimize the distance between the representations of different views (e. g., image and its caption) of the same data point while keeping the representations of different data points away from each other.
no code implementations • 3 Apr 2023 • Yunwei Ren, Mo Zhou, Rong Ge
Depth separation -- why a deeper network is more powerful than a shallower one -- has been a major problem in deep learning theory.
no code implementations • NeurIPS 2021 • Rong Ge, Yunwei Ren, Xiang Wang, Mo Zhou
In this paper we study the training dynamics for gradient flow on over-parametrized tensor decomposition problems.