Search Results for author: Jakob H. Macke

Found 38 papers, 20 papers with code

All-in-one simulation-based inference

1 code implementation15 Apr 2024 Manuel Gloeckler, Michael Deistler, Christian Weilbach, Frank Wood, Jakob H. Macke

Amortized Bayesian inference trains neural networks to solve stochastic inference problems using model simulations, thereby making it possible to rapidly perform Bayesian inference for any newly observed data.

Bayesian Inference Epidemiology

Diffusion Tempering Improves Parameter Estimation with Probabilistic Integrators for Ordinary Differential Equations

1 code implementation19 Feb 2024 Jonas Beck, Nathanael Bosch, Michael Deistler, Kyra L. Kadhim, Jakob H. Macke, Philipp Hennig, Philipp Berens

Ordinary differential equations (ODEs) are widely used to describe dynamical systems in science, but identifying parameters that explain experimental measurements is challenging.

Sourcerer: Sample-based Maximum Entropy Source Distribution Estimation

1 code implementation12 Feb 2024 Julius Vetter, Guy Moss, Cornelius Schröder, Richard Gao, Jakob H. Macke

Scientific modeling applications often require estimating a distribution of parameters consistent with a dataset of observations - an inference task also known as source distribution estimation.

valid

Amortized Bayesian Decision Making for simulation-based models

1 code implementation5 Dec 2023 Mila Gorecki, Jakob H. Macke, Michael Deistler

Simulation-based inference (SBI) provides a powerful framework for inferring posterior distributions of stochastic simulators in a wide range of domains.

Decision Making

Simulation-Based Inference of Surface Accumulation and Basal Melt Rates of an Antarctic Ice Shelf from Isochronal Layers

2 code implementations3 Dec 2023 Guy Moss, Vjeran Višnjević, Olaf Eisen, Falk M. Oraschewski, Cornelius Schröder, Jakob H. Macke, Reinhard Drews

The geometry of ice shelves, and hence their buttressing strength, is determined by ice flow as well as by the local surface accumulation and basal melt rates, governed by atmospheric and oceanic conditions.

Bayesian Inference

Flow Matching for Scalable Simulation-Based Inference

1 code implementation NeurIPS 2023 Maximilian Dax, Jonas Wildberger, Simon Buchholz, Stephen R. Green, Jakob H. Macke, Bernhard Schölkopf

Neural posterior estimation methods based on discrete normalizing flows have become established tools for simulation-based inference (SBI), but scaling them to high-dimensional problems can be challenging.

Generalized Bayesian Inference for Scientific Simulators via Amortized Cost Estimation

no code implementations NeurIPS 2023 Richard Gao, Michael Deistler, Jakob H. Macke

Generalized Bayesian Inference (GBI) aims to robustify inference for (misspecified) simulator models, replacing the likelihood-function with a cost function that evaluates the goodness of parameters relative to data.

Bayesian Inference

Adversarial robustness of amortized Bayesian inference

1 code implementation24 May 2023 Manuel Glöckler, Michael Deistler, Jakob H. Macke

Bayesian inference usually requires running potentially costly inference procedures separately for every new observation.

Adversarial Robustness Bayesian Inference

Simultaneous identification of models and parameters of scientific simulators

no code implementations24 May 2023 Cornelius Schröder, Jakob H. Macke

We approach this problem in an amortized simulation-based inference framework: We define implicit model priors over a fixed set of candidate components and train neural networks to infer joint probability distributions over both, model components and associated parameters from simulations.

Bayesian Inference

Multiscale Metamorphic VAE for 3D Brain MRI Synthesis

no code implementations9 Jan 2023 Jaivardhan Kapoor, Jakob H. Macke, Christian F. Baumgartner

Generative modeling of 3D brain MRIs presents difficulties in achieving high visual fidelity while ensuring sufficient coverage of the data distribution.

Adapting to noise distribution shifts in flow-based gravitational-wave inference

no code implementations16 Nov 2022 Jonas Wildberger, Maximilian Dax, Stephen R. Green, Jonathan Gair, Michael Pürrer, Jakob H. Macke, Alessandra Buonanno, Bernhard Schölkopf

Deep learning techniques for gravitational-wave parameter estimation have emerged as a fast alternative to standard samplers $\unicode{x2013}$ producing results of comparable accuracy.

Neural Importance Sampling for Rapid and Reliable Gravitational-Wave Inference

1 code implementation11 Oct 2022 Maximilian Dax, Stephen R. Green, Jonathan Gair, Michael Pürrer, Jonas Wildberger, Jakob H. Macke, Alessandra Buonanno, Bernhard Schölkopf

This shows a median sample efficiency of $\approx 10\%$ (two orders-of-magnitude better than standard samplers) as well as a ten-fold reduction in the statistical uncertainty in the log evidence.

Variational methods for simulation-based inference

1 code implementation ICLR 2022 Manuel Glöckler, Michael Deistler, Jakob H. Macke

We present Sequential Neural Variational Inference (SNVI), an approach to perform Bayesian inference in models with intractable likelihoods.

Bayesian Inference Variational Inference

Group equivariant neural posterior estimation

1 code implementation ICLR 2022 Maximilian Dax, Stephen R. Green, Jonathan Gair, Michael Deistler, Bernhard Schölkopf, Jakob H. Macke

We here describe an alternative method to incorporate equivariances under joint transformations of parameters and data.

Real-time gravitational-wave science with neural posterior estimation

1 code implementation23 Jun 2021 Maximilian Dax, Stephen R. Green, Jonathan Gair, Jakob H. Macke, Alessandra Buonanno, Bernhard Schölkopf

We demonstrate unprecedented accuracy for rapid gravitational-wave parameter estimation with deep learning.

Benchmarking Simulation-Based Inference

2 code implementations12 Jan 2021 Jan-Matthis Lueckmann, Jan Boelts, David S. Greenberg, Pedro J. Gonçalves, Jakob H. Macke

We set out to fill this gap: We provide a benchmark with inference tasks and suitable performance metrics, with an initial selection of algorithms including recent approaches employing neural networks and classical Approximate Bayesian Computation methods.

Benchmarking

SBI -- A toolkit for simulation-based inference

no code implementations17 Jul 2020 Alvaro Tejero-Cantero, Jan Boelts, Michael Deistler, Jan-Matthis Lueckmann, Conor Durkan, Pedro J. Gonçalves, David S. Greenberg, Jakob H. Macke

$\texttt{sbi}$ facilitates inference on black-box simulators for practising scientists and engineers by providing a unified interface to state-of-the-art algorithms together with documentation and tutorials.

Bayesian Inference

Inference of a mesoscopic population model from population spike trains

2 code implementations3 Oct 2019 Alexandre René, André Longtin, Jakob H. Macke

We derive the likelihood of both single-neuron and connectivity parameters given this activity, which can then be used to either optimize parameters by gradient ascent on the log-likelihood, or to perform Bayesian inference using Markov Chain Monte Carlo (MCMC) sampling.

Bayesian Inference

Intrinsic dimension of data representations in deep neural networks

1 code implementation NeurIPS 2019 Alessio Ansuini, Alessandro Laio, Jakob H. Macke, Davide Zoccolan

We find that, in a trained network, the ID is orders of magnitude smaller than the number of units in each layer.

Analyzing biological and artificial neural networks: challenges with opportunities for synergy?

no code implementations31 Oct 2018 David G. T. Barrett, Ari S. Morcos, Jakob H. Macke

We explore opportunities for synergy between the two fields, such as the use of DNNs as in-silico model systems for neuroscience, and how this synergy can lead to new hypotheses about the operating principles of biological neural networks.

Object Recognition

Likelihood-free inference with emulator networks

2 code implementations23 May 2018 Jan-Matthis Lueckmann, Giacomo Bassetto, Theofanis Karaletsos, Jakob H. Macke

Approximate Bayesian Computation (ABC) provides methods for Bayesian inference in simulation-based stochastic models which do not permit tractable likelihoods.

Bayesian Inference

Extracting low-dimensional dynamics from multiple large-scale neural population recordings by learning to predict correlations

no code implementations NeurIPS 2017 Marcel Nonnenmacher, Srinivas C. Turaga, Jakob H. Macke

Current approaches for dimensionality reduction on neural data are limited to single population recordings, and can not identify dynamics embedded across multiple measurements.

Dimensionality Reduction

Flexible statistical inference for mechanistic models of neural dynamics

1 code implementation NeurIPS 2017 Jan-Matthis Lueckmann, Pedro J. Goncalves, Giacomo Bassetto, Kaan Öcal, Marcel Nonnenmacher, Jakob H. Macke

Our approach builds on recent advances in ABC by learning a neural network which maps features of the observed data to the posterior distribution over parameters.

Bayesian Inference

Signatures of criticality arise in simple neural population models with correlations

1 code implementation29 Feb 2016 Marcel Nonnenmacher, Christian Behrens, Philipp Berens, Matthias Bethge, Jakob H. Macke

Support for this notion has come from a series of studies which identified statistical signatures of criticality in the ensemble activity of retinal ganglion cells.

Neurons and Cognition

Low-dimensional models of neural population activity in sensory cortical circuits

no code implementations NeurIPS 2014 Evan W. Archer, Urs Koster, Jonathan W. Pillow, Jakob H. Macke

Moreover, because the nonlinear stimulus inputs are mixed by the ongoing dynamics, the model can account for a relatively large number of idiosyncratic receptive field shapes with a small number of nonlinear inputs to a low-dimensional latent dynamical model.

A Bayesian model for identifying hierarchically organised states in neural population activity

no code implementations NeurIPS 2014 Patrick Putzky, Florian Franzen, Giacomo Bassetto, Jakob H. Macke

Here, we present a statistical model for extracting hierarchically organised neural population states from multi-channel recordings of neural spiking activity.

Bayesian Inference

Hierarchical models for neural population dynamics in the presence of non-stationarity

no code implementations12 Oct 2014 Mijung Park, Jakob H. Macke

Here, we introduce a hierarchical statistical model of neural population activity which models both neural population dynamics as well as inter-trial modulations in firing rates.

Variational Inference

Inferring neural population dynamics from multiple partial recordings of the same neural circuit

no code implementations NeurIPS 2013 Srini Turaga, Lars Buesing, Adam M. Packer, Henry Dalgleish, Noah Pettit, Michael Hausser, Jakob H. Macke

Simultaneous recordings of the activity of large neural populations are extremely valuable as they can be used to infer the dynamics and interactions of neurons in a local circuit, shedding light on the computations performed.

Spectral learning of linear dynamics from generalised-linear observations with application to neural population data

no code implementations NeurIPS 2012 Lars Buesing, Jakob H. Macke, Maneesh Sahani

Here, we show how spectral learning methods for linear systems with Gaussian observations (usually called subspace identification in this context) can be extended to estimate the parameters of dynamical system models observed through non-Gaussian noise models.

How biased are maximum entropy models?

no code implementations NeurIPS 2011 Jakob H. Macke, Iain Murray, Peter E. Latham

However, maximum entropy models fit to small data sets can be subject to sampling bias; i. e. the true entropy of the data can be severely underestimated.

Small Data Image Classification

Bayesian estimation of orientation preference maps

no code implementations NeurIPS 2009 Sebastian Gerwinn, Leonard White, Matthias Kaschube, Matthias Bethge, Jakob H. Macke

Imaging techniques such as optical imaging of intrinsic signals, 2-photon calcium imaging and voltage sensitive dye imaging can be used to measure the functional organization of visual cortex across different spatial scales.

Gaussian Processes

Receptive Fields without Spike-Triggering

no code implementations NeurIPS 2007 Guenther Zeck, Matthias Bethge, Jakob H. Macke

Can we find a concise description for the processing of a whole population of neurons analogous to the receptive field for single neurons?

Image Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.