Search Results for author:
Found 5 papers, 4 papers with code
MAXENT3D_PID: An Estimator for the Maximum-entropy Trivariate Partial Information Decomposition
Chicharro (2017) introduced a procedure to determine multivariate partial information measures within the maximum entropy framework, separating unique, redundant, and synergistic components of information.
Computation Optimization and Control
Introducing a differentiable measure of pointwise shared information
We here present a novel measure that satisfies this property, emerges solely from information-theoretic principles, and has the form of a local mutual information.
Information Theory Information Theory
Bits and Pieces: Understanding Information Decomposition from Part-whole Relationships and Formal Logic
In this paper we show, first, that the entire theory of partial information decomposition can be derived from considerations of elementary parthood relationships between information contributions.
A Measure of the Complexity of Neural Representations based on Partial Information Decomposition
However, the specific way in which this mutual information about the classification label is distributed among the individual neurons is not well understood: While parts of it may only be obtainable from specific single neurons, other parts are carried redundantly or synergistically by multiple neurons.
A General Framework for Interpretable Neural Learning based on Local Information-Theoretic Goal Functions
Despite the impressive performance of biological and artificial networks, an intuitive understanding of how their local learning dynamics contribute to network-level task solutions remains a challenge to this date.
