Search Results for author: Kenneth Barner

Found 5 papers, 1 papers with code

A Probabilistic Representation of DNNs: Bridging Mutual Information and Generalization

1 code implementation18 Jun 2021 Xinjie Lan, Kenneth Barner

However, it is intractable to accurately estimate the MI in DNNs, thus most previous works have to relax the MI bound, which in turn weakens the information theoretic explanation for generalization.

A Probabilistic Representation for Deep Learning: Delving into The Information Bottleneck Principle

no code implementations NeurIPS 2021 Xinjie Lan, Kenneth Barner

The Information Bottleneck (IB) principle has recently attracted great attention to explaining Deep Neural Networks (DNNs), and the key is to accurately estimate the mutual information between a hidden layer and dataset.

Cannot find the paper you are looking for? You can Submit a new open access paper.