Browse > Methodology > Information Plane

Information Plane

3 papers with code · Methodology

To obtain the Information Plane (IP) of deep neural networks, which shows the trajectories of the hidden layers during training in a 2D plane using as coordinate axes the mutual information between the input and the hidden layer, and the mutual information between the output and the hidden layer.

Leaderboards

No evaluation results yet. Help compare methods by submit evaluation metrics.

Greatest papers with code

Opening the Black Box of Deep Neural Networks via Information

2 Mar 2017ravidziv/IDNNs

Previous work proposed to analyze DNNs in the \textit{Information Plane}; i. e., the plane of the Mutual Information values that each layer preserves on the input and output variables.

INFORMATION PLANE

On the Information Bottleneck Theory of Deep Learning

ICLR 2018 artemyk/ibsgd

The practical successes of deep neural networks have not been matched by theoretical progress that satisfyingly explains their behavior.

INFORMATION PLANE

Scalable Mutual Information Estimation using Dependence Graphs

27 Jan 2018mrtnoshad/EDGE

To the best of our knowledge EDGE is the first non-parametric MI estimator that can achieve parametric MSE rates with linear time complexity.

INFORMATION PLANE MUTUAL INFORMATION ESTIMATION