Stochastic Optimization

General • 46 methods

Stochastic Optimization methods are used to optimize neural networks. We typically take a mini-batch of data, hence 'stochastic', and perform a type of gradient descent with this minibatch. Below you can find a continuously updating list of stochastic optimization algorithms.

Method Year Papers
2014 4424
1951 952
2013 234
1999 124
2011 81
2019 71
2018 52
2014 41
2019 23
2017 22
1983 20
2017 18
2016 18
2019 12
2018 10
2019 9
2019 8
2020 8
2012 7
2020 7
2017 6
2019 5
2020 5
2021 5
2000 5
2015 3
2014 2
2019 2
1991 2
2018 2
2018 2
2021 2
2000 2
2016 2
2018 1
2017 1
2018 1
2019 1
2017 1
2019 1
2019 1
2019 1
2019 1
2020 1
2019 1
2021 1