no code implementations • 9 Jun 2022 • El Mehdi Achour, Armand Foucault, Sébastien Gerchinovitz, François Malgouyres
Given two sets $F$, $G$ of real-valued functions, we first prove a general lower bound on how well functions in $F$ can be approximated in $L^p(\mu)$ norm by functions in $G$, for any $p \geq 1$ and any probability measure $\mu$.
no code implementations • 12 Aug 2021 • El Mehdi Achour, François Malgouyres, Franck Mamalet
Imposing orthogonality on the layers of neural networks is known to facilitate the learning by limiting the exploding/vanishing of the gradient; decorrelate the features; improve the robustness.
no code implementations • 28 Jul 2021 • El Mehdi Achour, François Malgouyres, Sébastien Gerchinovitz
We characterize, among all critical points, which are global minimizers, strict saddle points, and non-strict saddle points.