no code implementations • 6 Jan 2022 • Thomas Anderson, Adam Belay, Mosharaf Chowdhury, Asaf Cidon, Irene Zhang
The end of Dennard scaling and the slowing of Moore's Law has put the energy use of datacenters on an unsustainable path.
no code implementations • 19 Dec 2021 • Seo Jin Park, Joshua Fried, Sunghyun Kim, Mohammad Alizadeh, Adam Belay
As emerging deep neural network (DNN) models continue to grow in size, using large GPU clusters to train DNNs is becoming an essential requirement to achieving acceptable training times.
