Stochastic Optimization
Local SGD
Introduced by Stich in Local SGD Converges Fast and Communicates LittleLocal SGD is a distributed training technique that runs SGD independently in parallel on different workers and averages the sequences only once in a while.
Source: Local SGD Converges Fast and Communicates Little
Papers
| Paper | Code | Results | Date | Stars |
|---|
Tasks
| Task | Papers | Share |
|---|---|---|
| Federated Learning | 22 | 59.46% |
| Image Classification | 3 | 8.11% |
| Language Modelling | 2 | 5.41% |
| BIG-bench Machine Learning | 2 | 5.41% |
| Edge-computing | 2 | 5.41% |
| Blocking | 2 | 5.41% |
| Domain Generalization | 1 | 2.70% |
| Personalized Federated Learning | 1 | 2.70% |
| Machine Translation | 1 | 2.70% |
Usage Over Time
Components
| Component | Type |
|
|---|---|---|
| 🤖 No Components Found | You can add them if they exist; e.g. Mask R-CNN uses RoIAlign |
