no code implementations • 21 Jul 2023 • Zehan Zhu, Ye Tian, Yan Huang, Jinming Xu, Shibo He
Perfect synchronization in distributed machine learning problems is inefficient and even impossible due to the existence of latency, package losses and stragglers.
no code implementations • 8 Jul 2022 • Yan Huang, Ying Sun, Zehan Zhu, Changzhi Yan, Jinming Xu
We develop a general framework unifying several gradient-based stochastic optimization methods for empirical risk minimization problems both in centralized and distributed scenarios.