# Communication Compression for Decentralized Training

Hanlin TangShaoduo GanCe ZhangTong ZhangJi Liu

Optimizing distributed learning systems is an art of balancing between computation and communication. There have been two lines of research that try to deal with slower networks: {\em communication compression} for low bandwidth networks, and {\em decentralization} for high latency networks... (read more)

PDF Abstract