Stochastic Optimization

General • 48 methods

Stochastic Optimization methods are used to optimize neural networks. We typically take a mini-batch of data, hence 'stochastic', and perform a type of gradient descent with this minibatch. Below you can find a continuously updating list of stochastic optimization algorithms.

Method Year Papers
2014 5168
1951 1015
2013 252
1999 127
2019 90
2011 88
2018 71
2016 45
2014 41
2017 29
2019 25
1983 22
2017 21
2016 21
2019 13
2020 12
2021 11
2018 11
2019 9
2019 8
2012 7
2020 7
2000 6
2017 6
2019 5
2020 5
2016 3
2015 3
2019 3
2021 2
2018 2
1991 2
2018 2
2014 2
2000 2
2021 1
2019 1
2019 1
2018 1
2021 1
2020 1
2019 1
2019 1
2019 1
2019 1
2017 1
2018 1
2017 1