no code implementations • 21 Jun 2021 • Enda Yu, Dezun Dong, Yemao Xu, Shuo Ouyang, Xiangke Liao
Communication overhead is the key challenge for distributed training.
no code implementations • 6 Mar 2020 • Shuo Ouyang, Dezun Dong, Yemao Xu, Liquan Xiao
At the algorithm level, we describe how to reduce the number of communication rounds and transmitted bits per round.