Improving Neural Network Learning Through Dual Variable Learning Rates

no code implementations • 9 Feb 2020 • Elizabeth Liner, Risto Miikkulainen

This paper introduces and evaluates a novel training method for neural networks: Dual Variable Learning Rates (DVLR).