Search Results for author: Alibek Sailanbayev

Found 2 papers, 0 papers with code

Random Reshuffling with Variance Reduction: New Analysis and Better Rates

no code implementations19 Apr 2021 Grigory Malinovsky, Alibek Sailanbayev, Peter Richtárik

One of the tricks that works so well in practice that it is used as default in virtually all widely used machine learning software is {\em random reshuffling (RR)}.

BIG-bench Machine Learning

SGD: General Analysis and Improved Rates

no code implementations27 Jan 2019 Robert Mansel Gower, Nicolas Loizou, Xun Qian, Alibek Sailanbayev, Egor Shulgin, Peter Richtarik

By specializing our theorem to different mini-batching strategies, such as sampling with replacement and independent sampling, we derive exact expressions for the stepsize as a function of the mini-batch size.

Cannot find the paper you are looking for? You can Submit a new open access paper.