no code implementations • 22 Mar 2019 • Dominic Kafka, Daniel Wilke
Line searches are capable of adaptively resolving learning rate schedules.
no code implementations • 20 Mar 2019 • Dominic Kafka, Daniel Wilke
Mini-batch sub-sampling in neural network training is unavoidable, due to growing data demands, memory-limited computational resources such as graphical processing units (GPUs), and the dynamics of on-line learning.