Search Results for author: El Mehdi Achour

Found 3 papers, 0 papers with code

A general approximation lower bound in $L^p$ norm, with applications to feed-forward neural networks

no code implementations9 Jun 2022 El Mehdi Achour, Armand Foucault, Sébastien Gerchinovitz, François Malgouyres

Given two sets $F$, $G$ of real-valued functions, we first prove a general lower bound on how well functions in $F$ can be approximated in $L^p(\mu)$ norm by functions in $G$, for any $p \geq 1$ and any probability measure $\mu$.

Open-Ended Question Answering

Existence, Stability and Scalability of Orthogonal Convolutional Neural Networks

no code implementations12 Aug 2021 El Mehdi Achour, François Malgouyres, Franck Mamalet

Imposing orthogonality on the layers of neural networks is known to facilitate the learning by limiting the exploding/vanishing of the gradient; decorrelate the features; improve the robustness.

The loss landscape of deep linear neural networks: a second-order analysis

no code implementations28 Jul 2021 El Mehdi Achour, François Malgouyres, Sébastien Gerchinovitz

We characterize, among all critical points, which are global minimizers, strict saddle points, and non-strict saddle points.

Cannot find the paper you are looking for? You can Submit a new open access paper.