Search Results for author: Daniel Barzilai

Found 3 papers, 0 papers with code

Generalization in Kernel Regression Under Realistic Assumptions

no code implementations26 Dec 2023 Daniel Barzilai, Ohad Shamir

It is by now well-established that modern over-parameterized models seem to elude the bias-variance tradeoff and generalize well despite overfitting noise.

regression

Controlling the Inductive Bias of Wide Neural Networks by Modifying the Kernel's Spectrum

no code implementations26 Jul 2023 Amnon Geifman, Daniel Barzilai, Ronen Basri, Meirav Galun

We leverage the duality between wide neural networks and Neural Tangent Kernels and propose a preconditioned gradient descent method, which alters the trajectory of GD.

Inductive Bias

A Kernel Perspective of Skip Connections in Convolutional Networks

no code implementations27 Nov 2022 Daniel Barzilai, Amnon Geifman, Meirav Galun, Ronen Basri

Over-parameterized residual networks (ResNets) are amongst the most successful convolutional neural architectures for image processing.

Cannot find the paper you are looking for? You can Submit a new open access paper.