Search Results for author:
Found 4 papers, 2 papers with code
On the Impact of Device and Behavioral Heterogeneity in Federated Learning
Federated learning (FL) is becoming a popular paradigm for collaborative learning over distributed, private datasets owned by non-trusting entities.
On the Discrepancy between the Theoretical Analysis and Practical Implementations of Compressed Communication for Distributed Deep Learning
Compressed communication, in the form of sparsification or quantization of stochastic gradients, is employed to reduce communication costs in distributed data-parallel training of deep neural networks.
Natural Compression for Distributed Deep Learning
Our technique is applied individually to all entries of the to-be-compressed update vector and works by randomized rounding to the nearest (negative or positive) power of two, which can be computed in a "natural" way by ignoring the mantissa.
Scaling Distributed Machine Learning with In-Network Aggregation
Training machine learning models in parallel is an increasingly important workload.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
