Search Results for author: Damien Ferbach

Found 2 papers, 1 papers with code

Proving Linear Mode Connectivity of Neural Networks via Optimal Transport

2 code implementations29 Oct 2023 Damien Ferbach, Baptiste Goujaud, Gauthier Gidel, Aymeric Dieuleveut

The energy landscape of high-dimensional non-convex optimization problems is crucial to understanding the effectiveness of modern deep neural network architectures.

Linear Mode Connectivity

A General Framework For Proving The Equivariant Strong Lottery Ticket Hypothesis

no code implementations9 Jun 2022 Damien Ferbach, Christos Tsirigotis, Gauthier Gidel, Avishek, Bose

In this paper, we generalize the SLTH to functions that preserve the action of the group $G$ -- i. e. $G$-equivariant network -- and prove, with high probability, that one can approximate any $G$-equivariant network of fixed width and depth by pruning a randomly initialized overparametrized $G$-equivariant network to a $G$-equivariant subnetwork.

Translation

Cannot find the paper you are looking for? You can Submit a new open access paper.