1 code implementation • 11 Sep 2023 • Daniel Haider, Vincent Lostanlen, Martin Ehler, Peter Balazs
Numerical simulations align with our theory and suggest that the condition number of a convolutional layer follows a logarithmic scaling law between the number and length of the filters, which is reminiscent of discrete wavelet bases.
2 code implementations • 25 Jul 2023 • Vincent Lostanlen, Daniel Haider, Han Han, Mathieu Lagrange, Peter Balazs, Martin Ehler
Waveform-based deep learning faces a dilemma between nonparametric and parametric approaches.
1 code implementation • 18 Jul 2023 • Daniel Haider, Martin Ehler, Peter Balazs
The paper uses a frame-theoretic setting to study the injectivity of a ReLU-layer on the closed ball of $\mathbb{R}^n$ and its non-negative part.