Data Parallel Methods
Local SGD
Introduced by Stich in Local SGD Converges Fast and Communicates LittleLocal SGD is a distributed training technique that runs SGD independently in parallel on different workers and averages the sequences only once in a while.
Source: Local SGD Converges Fast and Communicates Little
Papers
| Paper | Code | Results | Date | Stars |
|---|
Tasks
| Task | Papers | Share |
|---|---|---|
| Federated Learning | 18 | 62.07% |
| Image Classification | 3 | 10.34% |
| BIG-bench Machine Learning | 2 | 6.90% |
| Edge-computing | 2 | 6.90% |
| Domain Generalization | 1 | 3.45% |
| Language Modelling | 1 | 3.45% |
| Personalized Federated Learning | 1 | 3.45% |
| Machine Translation | 1 | 3.45% |
Usage Over Time
Components
| Component | Type |
|
|---|---|---|
| 🤖 No Components Found | You can add them if they exist; e.g. Mask R-CNN uses RoIAlign |
