Improving Strong-Scaling of CNN Training by Exploiting Finer-Grained Parallelism

no code implementations • 15 Mar 2019 • Nikoli Dryden, Naoya Maruyama, Tom Benson, Tim Moon, Marc Snir, Brian Van Essen

We also see an emerging need to handle datasets with very large samples, where memory requirements for training are large.

Image Classification