no code implementations • ICLR 2021 • Michael Kleinman, Alessandro Achille, Daksh Idnani, Jonathan C. Kao
We introduce a notion of usable information contained in the representation learned by a deep network, and use it to study how optimal representations for the task emerge during training.