Understand Data Preprocessing for Effective End-to-End Training of Deep Neural Networks

no code implementations • 18 Apr 2023 • Ping Gong, Yuxin Ma, Cheng Li, Xiaosong Ma, Sam H. Noh

In this paper, we primarily focus on understanding the data preprocessing pipeline for DNN Training in the public cloud.

Accelerated Training for CNN Distributed Deep Learning through Automatic Resource-Aware Layer Placement

no code implementations • 17 Jan 2019 • Jay H. Park, Sunghwan Kim, Jinwon Lee, Myeongjae Jeon, Sam H. Noh

Through analysis of the characteristics of CNN, we find that placement of layers can be done in an effective manner.

Distributed, Parallel, and Cluster Computing