1 code implementation • 9 Apr 2020 • Weibing Deng, R. Xie, S. Deng, Armen E. Allahverdyan
The differences reveal a temporal asymmetry in meaningful texts, which is confirmed by showing that texts are much better compressible in their natural way (i. e. along the narrative) than in the word-inverted form.
no code implementations • 27 Sep 2019 • O Duranthon, M Marsili, R. Xie
We show that the mutual information between the representation of a learning machine and the hidden features that it extracts from data is bounded from below by the relevance, which is the entropy of the model's energy distribution.