Moniqua: Modulo Quantized Communication in Decentralized SGD

ICML 2020 Yucheng LuChristopher De Sa

Running Stochastic Gradient Descent (SGD) in a decentralized fashion has shown promising results. In this paper we propose Moniqua, a technique that allows decentralized SGD to use quantized communication... (read more)

PDF Abstract ICML 2020 PDF

Code


No code implementations yet. Submit your code now

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods used in the Paper