no code implementations • 16 Dec 2020 • Fengli Gao, Huicai Zhong
A curvature-based learning rate (CBLR) algorithm is proposed to better fit the curvature variation, a sensitive factor affecting large batch size training, across layers in a NN.
Scheduling