Search Results for author: Ilya Nemenman

Found 13 papers, 2 papers with code

Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses

no code implementations5 Oct 2023 Eslam Abdelaleem, Ilya Nemenman, K. Michael Martini

Using this framework, we rederive existing dimensionality reduction methods including the deep variational information bottleneck and variational auto-encoders.

Dimensionality Reduction Representation Learning

Simultaneous Dimensionality Reduction: A Data Efficient Approach for Multimodal Representations Learning

no code implementations5 Oct 2023 Eslam Abdelaleem, Ahmed Roman, K. Michael Martini, Ilya Nemenman

Remarkably, regularized CCA can identify low-dimensional weak covarying structures even when the number of samples is much smaller than the dimensionality of the data, which is a regime challenging for all dimensionality reduction methods.

Dimensionality Reduction

Data efficiency, dimensionality reduction, and the generalized symmetric information bottleneck

no code implementations11 Sep 2023 K. Michael Martini, Ilya Nemenman

The Symmetric Information Bottleneck (SIB), an extension of the more familiar Information Bottleneck, is a dimensionality reduction technique that simultaneously compresses two random variables to preserve information between their compressed versions.

Dimensionality Reduction

Inferring Local Structure from Pairwise Correlations

no code implementations7 May 2023 Mahajabin Rahman, Ilya Nemenman

To construct models of large, multivariate complex systems, such as those in biology, one needs to constrain which variables are allowed to interact.

Neural criticality from effective latent variables

no code implementations2 Jan 2023 Mia C. Morrell, Ilya Nemenman, Audrey J. Sederberg

More recently, power laws were also observed in neural populations in the mouse under an activity coarse-graining procedure, and they were explained as a consequence of the neural activity being coupled to multiple latent dynamical variables.

EEG

Intrinsic Motivation in Dynamical Control Systems

no code implementations29 Dec 2022 Stas Tiomkin, Ilya Nemenman, Daniel Polani, Naftali Tishby

Biological systems often choose actions without an explicit reward signal, a phenomenon known as intrinsic motivation.

Physical limit to concentration sensing in a changing environment

no code implementations12 Aug 2019 Thierry Mora, Ilya Nemenman

Cells adapt to changing environments by sensing ligand concentrations using specific receptors.

Receptor crosstalk improves concentration sensing of multiple ligands

no code implementations10 Oct 2018 Martin Carballo-Pacheco, Jonathan Desponds, Tatyana Gavrilchenko, Andreas Mayer, Roshan Prizak, Gautam Reddy, Ilya Nemenman, Thierry Mora

Crosstalk is often thought of as a deviation from optimal specific recognition, as the binding of non-cognate ligands can interfere with the detection of the receptor's cognate ligand, possibly leading to a false triggering of a downstream signaling pathway.

Automated, predictive, and interpretable inference of C. elegans escape dynamics

no code implementations25 Sep 2018 Bryan C. Daniels, William S. Ryu, Ilya Nemenman

The roundworm C. elegans exhibits robust escape behavior in response to rapidly rising temperature.

Stereotypical escape behavior in Caenorhabditis elegans allows quantification of nociceptive stimuli levels

1 code implementation18 Jan 2016 Kawai Leung, Aylia Mohammadi, William S. Ryu, Ilya Nemenman

We test the nociception of ibuprofen-treated worms and a TRPV (transient receptor potential) mutant, and we show that the perception of thermal nociception for the ibuprofen treated worms is lower than the wild-type.

Quantitative Methods Neurons and Cognition

Automated adaptive inference of coarse-grained dynamical models in systems biology

no code implementations24 Apr 2014 Bryan C. Daniels, Ilya Nemenman

Such adaptive models lead to accurate predictions even when microscopic details of the studied systems are unknown due to insufficient data.

Director Field Model of the Primary Visual Cortex for Contour Detection

no code implementations4 Oct 2013 Vijay Singh, Martin Tchernookov, Rebecca Butterfield, Ilya Nemenman

We aim to build the simplest possible model capable of detecting long, noisy contours in a cluttered visual scene.

Contour Detection

Entropy and inference, revisited

1 code implementation15 Aug 2001 Ilya Nemenman, Fariel Shafee, William Bialek

We study properties of popular near-uniform (Dirichlet) priors for learning undersampled probability distributions on discrete nonmetric spaces and show that they lead to disastrous results.

Data Analysis, Statistics and Probability

Cannot find the paper you are looking for? You can Submit a new open access paper.