Flag Aggregator: Scalable Distributed Training under Failures and Augmented Losses using Convex Optimization

1 code implementation • 12 Feb 2023 • Hamidreza Almasi, Harsh Mishra, Balajee Vamanan, Sathya N. Ravi

Therefore, to scale computation and data, these models are inevitably trained in a distributed manner in clusters of nodes, and their updates are aggregated before being applied to the model.

Data Augmentation