no code implementations • 7 Mar 2022 • Rudolf H. Riedi, Randall Balestriero, Richard G. Baraniuk
Building on our earlier work connecting deep networks with continuous piecewise-affine splines, we develop an exact local linear representation of a deep network layer for a family of modern deep networks that includes ConvNets at one end of a spectrum and ResNets, DenseNets, and other networks with skip connections at the other.