1 code implementation • 31 Jan 2021 • Geoffrey X. Yu, Yubo Gao, Pavel Golikov, Gennady Pekhimenko
Our technique exploits the observation that, because DNN training consists of repetitive compute steps, predicting the execution time of a single iteration is usually enough to characterize the performance of an entire training process.
