Search Results for author: Adrian Wills

Found 15 papers, 4 papers with code

Divide, Conquer, Combine Bayesian Decision Tree Sampling

no code implementations26 Mar 2024 Jodie A. Cochrane, Adrian Wills, Sarah J. Johnson

A challenge for existing MCMC approaches is proposing joint changes in both the tree structure and the decision parameters that result in efficient sampling.

Bayesian Inference

A Probabilistically Motivated Learning Rate Adaptation for Stochastic Optimization

no code implementations22 Feb 2021 Filip de Roos, Carl Jidling, Adrian Wills, Thomas Schön, Philipp Hennig

Machine learning practitioners invest significant manual and computational resources in finding suitable learning rates for optimization algorithms.

BIG-bench Machine Learning Stochastic Optimization

Variational State and Parameter Estimation

no code implementations14 Dec 2020 Jarrad Courts, Johannes Hendriks, Adrian Wills, Thomas Schön, Brett Ninness

In this work, a variational approach is used to provide an assumed density which approximates the desired, intractable, distribution.

Variational System Identification for Nonlinear State-Space Models

no code implementations8 Dec 2020 Jarrad Courts, Adrian Wills, Thomas Schön, Brett Ninness

This paper considers parameter estimation for nonlinear state-space models, which is an important but challenging problem.

Variational Inference

Gaussian Variational State Estimation for Nonlinear State-Space Models

no code implementations7 Feb 2020 Jarrad Courts, Adrian Wills, Thomas B. Schön

In this paper, the problem of state estimation, in the context of both filtering and smoothing, for nonlinear state-space models is considered.

Variational Inference

Linearly Constrained Neural Networks

1 code implementation5 Feb 2020 Johannes Hendriks, Carl Jidling, Adrian Wills, Thomas Schön

We present a novel approach to modelling and learning vector fields from physical systems using neural networks that explicitly satisfy known linear operator constraints.

Gaussian Processes

Learning Continuous Occupancy Maps with the Ising Process Model

no code implementations18 Oct 2019 Nicholas O'Dell, Christopher Renton, Adrian Wills

The method is quite attractive as it requires only a small number of hyperparameters to be trained, and is computationally efficient.

Robot Navigation

Deep kernel learning for integral measurements

no code implementations4 Sep 2019 Carl Jidling, Johannes Hendriks, Thomas B. Schön, Adrian Wills

Deep kernel learning refers to a Gaussian process that incorporates neural networks to improve the modelling of complex functions.

Stochastic quasi-Newton with line-search regularization

no code implementations3 Sep 2019 Adrian Wills, Thomas Schön

In this paper we present a novel quasi-Newton algorithm for use in stochastic optimisation.

A fast quasi-Newton-type method for large-scale stochastic optimisation

no code implementations ICLR 2019 Adrian Wills, Carl Jidling, Thomas Schon

During recent years there has been an increased interest in stochastic adaptations of limited memory quasi-Newton methods, which compared to pure gradient-based routines can improve the convergence by incorporating second order information.

Vocal Bursts Type Prediction

Correlated pseudo-marginal Metropolis-Hastings using quasi-Newton proposals

1 code implementation26 Jun 2018 Johan Dahlin, Adrian Wills, Brett Ninness

Pseudo-marginal Metropolis-Hastings (pmMH) is a versatile algorithm for sampling from target distributions which are not easy to evaluate point-wise.

Stochastic quasi-Newton with adaptive step lengths for large-scale problems

no code implementations12 Feb 2018 Adrian Wills, Thomas Schön

We provide a numerically robust and fast method capable of exploiting the local geometry when solving large-scale stochastic optimisation problems.

Constructing Metropolis-Hastings proposals using damped BFGS updates

1 code implementation4 Jan 2018 Johan Dahlin, Adrian Wills, Brett Ninness

The computation of Bayesian estimates of system parameters and functions of them on the basis of observed system performance data is a common problem within system identification.

Computation Computational Finance

Linearly constrained Gaussian processes

no code implementations NeurIPS 2017 Carl Jidling, Niklas Wahlström, Adrian Wills, Thomas B. Schön

We consider a modification of the covariance function in Gaussian processes to correctly account for known linear constraints.

Gaussian Processes

Newton-based maximum likelihood estimation in nonlinear state space models

1 code implementation12 Feb 2015 Manon Kok, Johan Dahlin, Thomas B. Schön, Adrian Wills

Maximum likelihood (ML) estimation using Newton's method in nonlinear state space models (SSMs) is a challenging problem due to the analytical intractability of the log-likelihood and its gradient and Hessian.

valid

Cannot find the paper you are looking for? You can Submit a new open access paper.