A whitening approach for Transfer Entropy permits the application to narrow-band signals

no code implementations • 7 Jan 2022 • Christoph Daube, Joachim Gross, Robin A. A. Ince

We simulate simplistic examples where we confirm the failure of classic implementations of Transfer Entropy when applied to narrow-band signals, as made evident by a flawed recovery of effect sizes and interaction delays.

Deeper Interpretability of Deep Networks

no code implementations • 19 Nov 2018 • Tian Xu, Jiayu Zhan, Oliver G. B. Garrod, Philip H. S. Torr, Song-Chun Zhu, Robin A. A. Ince, Philippe G. Schyns

However, understanding the information represented and processed in CNNs remains in most cases challenging.

Exact partial information decompositions for Gaussian systems based on dependency constraints

1 code implementation • 6 Mar 2018 • James W. Kay, Robin A. A. Ince

Here, we apply the Idep approach to Gaussian systems, for which the marginally constrained maximum entropy models are Gaussian graphical models.

The Partial Entropy Decomposition: Decomposing multivariate entropy and mutual information via pointwise common surprisal

1 code implementation • 6 Feb 2017 • Robin A. A. Ince

Recently, the Partial Information Decomposition (PID) was proposed to decompose mutual information (MI) about a target variable into components which are redundant, unique and synergistic within different subsets of predictor variables.

Information Theory Information Theory Statistics Theory Neurons and Cognition Quantitative Methods Methodology Statistics Theory

Measuring multivariate redundant information with pointwise common change in surprisal

1 code implementation • 16 Feb 2016 • Robin A. A. Ince

We present a new measure of redundancy which measures the common change in surprisal shared between variables at the local or pointwise level.

Information Theory Information Theory Statistics Theory Neurons and Cognition Quantitative Methods Methodology Statistics Theory