Search Results for author: Artemy Kolchinsky

Found 14 papers, 7 papers with code

Thermodynamics of Darwinian evolution in molecular replicators

no code implementations6 Dec 2021 Artemy Kolchinsky

We consider the relationship between thermodynamics, fitness, and Darwinian evolution in autocatalytic molecular replicators.

The Computational Capacity of LRC, Memristive and Hybrid Reservoirs

no code implementations31 Aug 2020 Forrest C. Sheldon, Artemy Kolchinsky, Francesco Caravelli

By introducing measures of the total linear and nonlinear computational capacities of the reservoir, we are able to design electronic circuits whose total computational capacity scales extensively with the system size.

Time Series Time Series Analysis

A Novel Approach to the Partial Information Decomposition

1 code implementation23 Aug 2019 Artemy Kolchinsky

We consider the "partial information decomposition" (PID) problem, which aims to decompose the information that a set of source random variables provide about a target random variable into separate redundant, synergistic, union, and unique components.

Decomposing information into copying versus transformation

no code implementations21 Mar 2019 Artemy Kolchinsky, Bernat Corominas-Murtra

In many real-world systems, information can be transmitted in two qualitatively different ways: by copying or by transformation.

Caveats for information bottleneck in deterministic scenarios

1 code implementation ICLR 2019 Artemy Kolchinsky, Brendan D. Tracey, Steven Van Kuyk

We demonstrate three caveats when using IB in any situation where $Y$ is a deterministic function of $X$: (1) the IB curve cannot be recovered by maximizing the IB Lagrangian for different values of $\beta$; (2) there are "uninteresting" trivial solutions at all points of the IB curve; and (3) for multi-layer classifiers that achieve low prediction error, different layers cannot exhibit a strict trade-off between compression and prediction, contrary to a recent proposal.

On the Information Bottleneck Theory of Deep Learning

1 code implementation ICLR 2018 Andrew Michael Saxe, Yamini Bansal, Joel Dapello, Madhu Advani, Artemy Kolchinsky, Brendan Daniel Tracey, David Daniel Cox

The practical successes of deep neural networks have not been matched by theoretical progress that satisfyingly explains their behavior.

Information Plane

The Minor Fall, the Major Lift: Inferring Emotional Valence of Musical Chords through Lyrics

1 code implementation26 Jun 2017 Artemy Kolchinsky, Nakul Dhande, Kengjeun Park, Yong-Yeol Ahn

We investigate the association between musical chords and lyrics by analyzing a large dataset of user-contributed guitar tablatures.

Estimating Mixture Entropy with Pairwise Distances

no code implementations8 Jun 2017 Artemy Kolchinsky, Brendan D. Tracey

We prove this family includes lower and upper bounds on the mixture entropy.

Nonlinear Information Bottleneck

3 code implementations6 May 2017 Artemy Kolchinsky, Brendan D. Tracey, David H. Wolpert

Information bottleneck (IB) is a technique for extracting information in one random variable $X$ that is relevant for predicting another random variable $Y$.

Dynamics of beneficial epidemics

1 code implementation7 Apr 2016 Andrew Berdahl, Christa Brelsford, Caterina De Bacco, Marion Dumas, Vanessa Ferdinand, Joshua A. Grochow, Laurent Hébert-Dufresne, Yoav Kallus, Christopher P. Kempes, Artemy Kolchinsky, Daniel B. Larremore, Eric Libby, Eleanor A. Power, Caitlin A. Stern, Brendan Tracey

Third, in the context of dynamic social networks, we find that preferences for increased global infection accelerate spread and produce superexponential fixation, but preferences for local assortativity halt epidemics by disconnecting the infected from the susceptible.

Physics and Society Multiagent Systems Social and Information Networks Adaptation and Self-Organizing Systems Populations and Evolution

Modularity and the spread of perturbations in complex dynamical systems

1 code implementation15 Sep 2015 Artemy Kolchinsky, Alexander J. Gates, Luis M. Rocha

We propose a method to decompose dynamical systems based on the idea that modules constrain the spread of perturbations.

Physics and Society Social and Information Networks Adaptation and Self-Organizing Systems Data Analysis, Statistics and Probability

Extraction of Pharmacokinetic Evidence of Drug-drug Interactions from the Literature

no code implementations2 Dec 2014 Artemy Kolchinsky, Anália Lourenço, Heng-Yi Wu, Lang Li, Luis M. Rocha

We used manually curated corpora of PubMed abstracts and annotated sentences to evaluate the efficacy of literature mining on two tasks: first, identifying PubMed abstracts containing pharmacokinetic evidence of DDIs; second, extracting sentences containing such evidence from abstracts.

Epidemiology General Classification +3

Prediction and Modularity in Dynamical Systems

no code implementations19 Jun 2011 Artemy Kolchinsky, Luis M. Rocha

Identifying and understanding modular organizations is centrally important in the study of complex systems.

Cannot find the paper you are looking for? You can Submit a new open access paper.