Search Results for author: Daniel Wilke

Found 2 papers, 0 papers with code

Gradient-only line searches: An Alternative to Probabilistic Line Searches

no code implementations22 Mar 2019 Dominic Kafka, Daniel Wilke

Line searches are capable of adaptively resolving learning rate schedules.

Traversing the noise of dynamic mini-batch sub-sampled loss functions: A visual guide

no code implementations20 Mar 2019 Dominic Kafka, Daniel Wilke

Mini-batch sub-sampling in neural network training is unavoidable, due to growing data demands, memory-limited computational resources such as graphical processing units (GPUs), and the dynamics of on-line learning.

Stochastic Optimization

Cannot find the paper you are looking for? You can Submit a new open access paper.