Doing More by Doing Less: How Structured Partial Backpropagation Improves Deep Learning Clusters

1 code implementation • 20 Nov 2021 • Adarsh Kumar, Kausik Subramanian, Shivaram Venkataraman, Aditya Akella

This simultaneously reduces network bandwidth, compute utilization, and memory footprint while preserving model quality.

Scheduling