Search Results for author: Fengli Gao

Found 1 papers, 0 papers with code

Study on the Large Batch Size Training of Neural Networks Based on the Second Order Gradient

no code implementations16 Dec 2020 Fengli Gao, Huicai Zhong

A curvature-based learning rate (CBLR) algorithm is proposed to better fit the curvature variation, a sensitive factor affecting large batch size training, across layers in a NN.

Scheduling

Cannot find the paper you are looking for? You can Submit a new open access paper.