no code implementations • 12 May 2023 • Kirsten Fischer, David Dahmen, Moritz Helias
We here derive a systematic finite-size theory for ResNets to study signal propagation and its dependence on the scaling for the residual branch.
no code implementations • 10 Feb 2022 • Kirsten Fischer, Alexandre René, Christian Keup, Moritz Layer, David Dahmen, Moritz Helias
Understanding the functional principles of information processing in deep neural networks continues to be a challenge, in particular for networks with trained and thus non-random weights.
2 code implementations • ICLR 2020 • Michael Volpp, Lukas P. Fröhlich, Kirsten Fischer, Andreas Doerr, Stefan Falkner, Frank Hutter, Christian Daniel
Transferring knowledge across tasks to improve data-efficiency is one of the open key challenges in the field of global black-box optimization.