General • Optimization • 62 methods
Stochastic Optimization methods are used to optimize neural networks. We typically take a mini-batch of data, hence 'stochastic', and perform a type of gradient descent with this minibatch. Below you can find a continuously updating list of stochastic optimization algorithms.
Subcategories
Method | Year | Papers |
---|---|---|
2014 | 17550 | |
1951 | 1744 | |
2018 | 581 | |
2013 | 430 | |
2019 | 179 | |
2011 | 168 | |
2017 | 148 | |
1999 | 141 | |
2016 | 140 | |
2021 | 133 | |
2020 | 93 | |
2014 | 91 | |
2017 | 66 | |
2018 | 59 | |
2019 | 50 | |
2019 | 47 | |
2016 | 41 | |
2020 | 38 | |
2018 | 37 | |
2017 | 30 | |
2021 | 30 | |
1983 | 27 | |
2019 | 25 | |
2020 | 18 | |
2019 | 16 | |
2000 | 15 | |
2012 | 15 | |
2019 | 11 | |
2019 | 11 | |
2000 | 10 | |
2016 | 10 | |
2021 | 9 | |
2022 | 9 | |
2014 | 8 | |
2017 | 6 | |
2019 | 5 | |
2021 | 4 | |
2015 | 4 | |
2018 | 3 | |
2019 | 3 | |
2021 | 2 | |
2018 | 2 | |
1991 | 2 | |
2020 | 2 | |
2022 | 2 | |
2019 | 1 | |
2019 | 1 | |
2023 | 1 | |
2022 | 1 | |
2019 | 1 | |
2019 | 1 | |
2022 | 1 | |
2021 | 1 | |
2017 | 1 | |
2019 | 1 | |
2017 | 1 | |
2018 | 1 | |
2021 | 1 | |
2021 | 1 | |
2018 | 1 | |
2000 | 0 |