no code implementations • 19 Feb 2018 • Sheng-Wei Chen, Chun-Nan Chou, Edward Y. Chang
For training fully-connected neural networks (FCNNs), we propose a practical approximate second-order method including: 1) an approximation of the Hessian matrix and 2) a conjugate gradient (CG) based method.