Search Results for author: Haifeng Lu

Found 2 papers, 0 papers with code

Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey

no code implementations9 Apr 2024 Feng Liang, Zhen Zhang, Haifeng Lu, Victor C. M. Leung, Yanyi Guo, Xiping Hu

Due to intensive synchronization of models and sharing of data across GPUs and computing nodes during distributed training and inference processes, communication efficiency becomes the bottleneck for achieving high performance at a large scale.

Data Compression Scheduling

Cannot find the paper you are looking for? You can Submit a new open access paper.