Generalization Bounds

131 papers with code • 0 benchmarks • 0 datasets

This task has no description! Would you like to contribute one?

Latest papers with no code

Improved Generalization Bounds for Communication Efficient Federated Learning

no code yet • 17 Apr 2024

This paper focuses on reducing the communication cost of federated learning by exploring generalization bounds and representation learning.

Generalization Bounds for Message Passing Networks on Mixture of Graphons

no code yet • 4 Apr 2024

In this more realistic and challenging scenario, we provide a generalization bound that decreases as the average number of nodes in the graphs increases.

Information-Theoretic Generalization Bounds for Deep Neural Networks

no code yet • 4 Apr 2024

This enables refining our generalization bounds to capture the contraction as a function of the network architecture parameters.

An Information-Theoretic Framework for Out-of-Distribution Generalization

no code yet • 29 Mar 2024

We study the Out-of-Distribution (OOD) generalization in machine learning and propose a general framework that provides information-theoretic generalization bounds.

A note on generalization bounds for losses with finite moments

no code yet • 25 Mar 2024

Moreover, the paper derives a high-probability PAC-Bayes bound for losses with a bounded variance.

Generalization of Scaled Deep ResNets in the Mean-Field Regime

no code yet • 14 Mar 2024

To derive the generalization bounds under this setting, our analysis necessitates a shift from the conventional time-invariant Gram matrix employed in the lazy training regime to a time-variant, distribution-dependent version.

Towards Robust Out-of-Distribution Generalization Bounds via Sharpness

no code yet • 11 Mar 2024

To bridge this gap between optimization and OOD generalization, we study the effect of sharpness on how a model tolerates data change in domain shift which is usually captured by "robustness" in generalization.

Generalization of Graph Neural Networks through the Lens of Homomorphism

no code yet • 10 Mar 2024

In this work, we propose to study the generalization of GNNs through a novel perspective - analyzing the entropy of graph homomorphism.

On Generalization Bounds for Deep Compound Gaussian Neural Networks

no code yet • 20 Feb 2024

In this paper, we develop novel generalization error bounds for a class of unrolled DNNs that are informed by a compound Gaussian prior.

Information Complexity of Stochastic Convex Optimization: Applications to Generalization and Memorization

no code yet • 14 Feb 2024

In this work, we investigate the interplay between memorization and learning in the context of \emph{stochastic convex optimization} (SCO).