Information Theory in Density Destructors

2 code implementations • 2 Dec 2020 • J. Emmanuel Johnson, Valero Laparra, Gustau Camps-Valls, Raul Santos-Rodríguez, Jesús Malo

Density destructors are differentiable and invertible transforms that map multivariate PDFs of arbitrary structure (low entropy) into non-structured PDFs (maximum entropy).

Information Theory Measures via Multidimensional Gaussianization

4 code implementations • 8 Oct 2020 • Valero Laparra, J. Emmanuel Johnson, Gustau Camps-Valls, Raul Santos-Rodríguez, Jesus Malo

Information theory is an outstanding framework to measure uncertainty, dependence and relevance in data and systems.

Density Estimation