Search Results for author: Chung-Yiu Yau

Found 2 papers, 0 papers with code

EMC$^2$: Efficient MCMC Negative Sampling for Contrastive Learning with Global Convergence

no code implementations16 Apr 2024 Chung-Yiu Yau, Hoi-To Wai, Parameswaran Raman, Soumajyoti Sarkar, Mingyi Hong

We follow the global contrastive learning loss as introduced in SogCLR, and propose EMC$^2$ which utilizes an adaptive Metropolis-Hastings subroutine to generate hardness-aware negative samples in an online fashion during the optimization.

Contrastive Learning

DoCoM: Compressed Decentralized Optimization with Near-Optimal Sample Complexity

no code implementations1 Feb 2022 Chung-Yiu Yau, Hoi-To Wai

This paper proposes the Doubly Compressed Momentum-assisted stochastic gradient tracking algorithm $\texttt{DoCoM}$ for communication-efficient decentralized optimization.

Cannot find the paper you are looking for? You can Submit a new open access paper.