Replicated Data Parallel
General • Data Parallel Methods • 4 methods
Methods
| Method | Year | Papers |
|---|---|---|
| 2020 | 2 | |
| 2021 | 1 | |
| 2019 | 1 | |
| 2020 | 1 |
PyTorch DDP
BAGUA
ByteScheduler
DABMD
