On the Information Bottleneck Theory of Deep Learning

1 code implementation • ICLR 2018 • Andrew Michael Saxe, Yamini Bansal, Joel Dapello, Madhu Advani, Artemy Kolchinsky, Brendan Daniel Tracey, David Daniel Cox

The practical successes of deep neural networks have not been matched by theoretical progress that satisfyingly explains their behavior.

Deep Learning Information Plane