Search Results for author: Tommaso Bonato

Found 2 papers, 0 papers with code

Swing: Short-cutting Rings for Higher Bandwidth Allreduce

no code implementations17 Jan 2024 Daniele De Sensi, Tommaso Bonato, David Saam, Torsten Hoefler

The allreduce collective operation accounts for a significant fraction of the runtime of workloads running on distributed systems.

HammingMesh: A Network Topology for Large-Scale Deep Learning

no code implementations3 Sep 2022 Torsten Hoefler, Tommaso Bonato, Daniele De Sensi, Salvatore Di Girolamo, Shigang Li, Marco Heddes, Jon Belk, Deepak Goel, Miguel Castro, Steve Scott

Numerous microarchitectural optimizations unlocked tremendous processing power for deep neural networks that in turn fueled the AI revolution.

Scheduling

Cannot find the paper you are looking for? You can Submit a new open access paper.