no code implementations • 12 Nov 2020 • Botelho, Joshi, A., Khara, Sarkar, S., Hegde, C., Rao, V., Adavani, S.S., & Ganapathysubramanian, B.
Here we report on a software framework for data parallel distributed deep learning that resolves the twin challenges of training these large SciML models training in reasonable time as well as distributing the storage requirements.