Stochastic Optimization

GeneralOptimization • 58 methods

Stochastic Optimization methods are used to optimize neural networks. We typically take a mini-batch of data, hence 'stochastic', and perform a type of gradient descent with this minibatch. Below you can find a continuously updating list of stochastic optimization algorithms.

Subcategories

Method Year Papers
2014 8827
1951 1302
2013 321
2018 228
2019 140
1999 133
2011 116
2016 82
2021 57
2014 56
2017 51
2018 44
2017 38
2019 36
2020 36
2016 25
1983 24
2018 22
2019 21
2017 20
2020 16
2019 15
2020 13
2012 12
2021 10
2019 10
2000 7
2017 6
2019 6
2019 5
2016 5
2014 4
2021 4
2021 4
2019 4
2000 4
2015 3
2018 3
2019 3
2018 2
1991 2
2022 2
2019 1
2019 1
2020 1
2019 1
2021 1
2019 1
2021 1
2017 1
2019 1
2017 1
2018 1
2021 1
2021 1
2018 1
2000 0