no code implementations • 29 Aug 2023 • Xin Zhou, Ling Chen, Houming Wu
In this paper, we propose a delayed synchronous SGD algorithm with adaptive batch size (ABS-SGD) for heterogeneous GPU clusters.
