Clairvoyant Prefetching for Distributed Machine Learning I/O

no code implementations • 21 Jan 2021 • Nikoli Dryden, Roman Böhringer, Tal Ben-Nun, Torsten Hoefler

I/O is emerging as a major bottleneck for machine learning training, especially in distributed environments.

BIG-bench Machine Learning