Search Results for author: Haoze He

Found 2 papers, 0 papers with code

Accelerating Parallel Stochastic Gradient Descent via Non-blocking Mini-batches

no code implementations2 Nov 2022 Haoze He, Parijat Dube

In this paper, we propose the (de)centralized Non-blocking SGD (Non-blocking SGD) which can address the straggler problem in a heterogeneous environment.

Blocking Computational Efficiency

RCD-SGD: Resource-Constrained Distributed SGD in Heterogeneous Environment via Submodular Partitioning

no code implementations2 Nov 2022 Haoze He, Parijat Dube

The convergence of SGD based distributed training algorithms is tied to the data distribution across workers.

Cannot find the paper you are looking for? You can Submit a new open access paper.