Yet Another Accelerated SGD: ResNet-50 Training on ImageNet in 74.7 seconds

29 Mar 2019Masafumi YamazakiAkihiko KasagiAkihiro TabuchiTakumi HondaMasahiro MiwaNaoto FukumotoTsuguchika TabaruAtsushi IkeKohta Nakashima

There has been a strong demand for algorithms that can execute machine learning as faster as possible and the speed of deep learning has accelerated by 30 times only in the past two years. Distributed deep learning using the large mini-batch is a key technology to address the demand and is a great challenge as it is difficult to achieve high scalability on large clusters without compromising accuracy... (read more)

PDF Abstract

Code


No code implementations yet. Submit your code now

Tasks


Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods used in the Paper


METHOD TYPE
🤖 No Methods Found Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet