no code implementations • 15 Jun 2023 • Paweł Piwek, Adam Klukowski, Tianyang Hu
Classic learning theory suggests that proper regularization is the key to good generalization and robustness.
no code implementations • 4 Nov 2021 • Adam Klukowski
For networks with a polynomial activation, we demonstrate that the rate of this convergence in 2-Wasserstein metric is $O(n^{-\frac{1}{2}})$, where $n$ is the number of hidden neurons.
no code implementations • 29 Sep 2021 • Adam Klukowski
We study deep fully-connected neural networks using the mean field formalism, and carry out a non-perturbative analysis of signal propagation.