Search Results for author: Yunwei Ren

Found 3 papers, 0 papers with code

On the Importance of Contrastive Loss in Multimodal Learning

no code implementations7 Apr 2023 Yunwei Ren, Yuanzhi Li

Recently, contrastive learning approaches (e. g., CLIP (Radford et al., 2021)) have received huge success in multimodal learning, where the model tries to minimize the distance between the representations of different views (e. g., image and its caption) of the same data point while keeping the representations of different data points away from each other.

Contrastive Learning

Depth Separation with Multilayer Mean-Field Networks

no code implementations3 Apr 2023 Yunwei Ren, Mo Zhou, Rong Ge

Depth separation -- why a deeper network is more powerful than a shallower one -- has been a major problem in deep learning theory.

Learning Theory

Understanding Deflation Process in Over-parametrized Tensor Decomposition

no code implementations NeurIPS 2021 Rong Ge, Yunwei Ren, Xiang Wang, Mo Zhou

In this paper we study the training dynamics for gradient flow on over-parametrized tensor decomposition problems.

Tensor Decomposition

Cannot find the paper you are looking for? You can Submit a new open access paper.