no code implementations • 1 Aug 2022 • Cristian Simionescu, George Stoica, Robert Herscovici
Additionally, we find that DBA produces an increased improvement over standard optimizers when used in data scarce conditions where, in addition to convergence speed, it also significantly improves model generalization, managing to train a network with a single fully connected hidden layer using only 1% of the MNIST dataset to reach 97. 79% test accuracy.