no code implementations • NeurIPS 2021 • Julian Zilly, Alessandro Achille, Andrea Censi, Emilio Frazzoli
In particular, we show that, when using weight decay, weights in successive layers of a deep network may become "mutually frozen".
no code implementations • 19 Dec 2019 • Julian Zilly, Lorenz Hetzel, Andrea Censi, Emilio Frazzoli
To quantify this alignment effect of data representations on the difficulty of a learning task, we make use of an existing task complexity score and show its connection to the representation-dependent information coding length of the input.
no code implementations • 25 Sep 2019 • Julian Zilly, Hannes Zilly, Oliver Richter, Roger Wattenhofer, Andrea Censi, Emilio Frazzoli
Empirically across several data domains, we substantiate this viewpoint by showing that test performance correlates strongly with the distance in data distributions between training and test set.
no code implementations • 22 Jul 2017 • Julian Zilly, Amit Boyarski, Micael Carvalho, Amir Atapour Abarghouei, Konstantinos Amplianitis, Aleksandr Krasnov, Massimiliano Mancini, Hernán Gonzalez, Riccardo Spezialetti, Carlos Sampedro Pérez, Hao Li
Reviewing this project with modern eyes provides us with the opportunity to reflect on several issues, relevant now as then to the field of computer vision and research in general, that go beyond the technical aspects of the work.