no code implementations • 23 Sep 2019 • Huaqing Zhang, Xiaolin Cheng, Hui Zang, Dae Hoon Park
Compiler-level optimization of GEMM has significant performance impact on training and executing deep learning models.
no code implementations • 20 Nov 2018 • Dae Hoon Park, Chiu Man Ho, Yi Chang, Huaqing Zhang
However, we observe that imposing strong L1 or L2 regularization with stochastic gradient descent on deep neural networks easily fails, which limits the generalization ability of the underlying neural networks.