Search Results for author: Sebastian Ament

Found 15 papers, 6 papers with code

Deep Reasoning Networks for Unsupervised Pattern De-mixing with Constraint Reasoning

no code implementations ICML 2020 Di Chen, Yiwei Bai, Wenting Zhao, Sebastian Ament, John Gregoire, Carla Gomes

We introduce Deep Reasoning Networks (DRNets), an end-to-end framework that combines deep learning with constraint reasoning for solving pattern de-mixing problems, typically in an unsupervised or very-weakly-supervised setting.

Unexpected Improvements to Expected Improvement for Bayesian Optimization

no code implementations NeurIPS 2023 Sebastian Ament, Samuel Daulton, David Eriksson, Maximilian Balandat, Eytan Bakshy

Expected Improvement (EI) is arguably the most popular acquisition function in Bayesian optimization and has found countless successful applications, but its performance is often exceeded by that of more recent methods.

Bayesian Optimization

Sustainable Concrete via Bayesian Optimization

1 code implementation27 Oct 2023 Sebastian Ament, Andrew Witte, Nishant Garg, Julius Kusuma

Herein, we 1) propose modeling steps that make concrete strength amenable to be predicted accurately by a Gaussian process model with relatively few measurements, 2) formulate the search for sustainable concrete as a multi-objective optimization problem, and 3) leverage the proposed model to carry out multi-objective BO with real-world strength measurements of the algorithmically proposed mixes.

Bayesian Optimization Experimental Design

Probabilistic Phase Labeling and Lattice Refinement for Autonomous Material Research

1 code implementation15 Aug 2023 Ming-Chiang Chang, Sebastian Ament, Maximilian Amsler, Duncan R. Sutherland, Lan Zhou, John M. Gregoire, Carla P. Gomes, R. Bruce van Dover, Michael O. Thompson

X-ray diffraction (XRD) is an essential technique to determine a material's crystal structure in high-throughput experimentation, and has recently been incorporated in artificially intelligent agents in autonomous scientific discovery processes.

X-Ray Diffraction (XRD)

Bayesian Optimization over High-Dimensional Combinatorial Spaces via Dictionary-based Embeddings

1 code implementation3 Mar 2023 Aryan Deshwal, Sebastian Ament, Maximilian Balandat, Eytan Bakshy, Janardhan Rao Doppa, David Eriksson

We use Bayesian Optimization (BO) and propose a novel surrogate modeling approach for efficiently handling a large number of binary and categorical parameters.

Bayesian Optimization Vocal Bursts Intensity Prediction

Scalable First-Order Bayesian Optimization via Structured Automatic Differentiation

1 code implementation16 Jun 2022 Sebastian Ament, Carla Gomes

To improve the performance of BO, prior work suggested incorporating gradient information into a Gaussian process surrogate of the objective, giving rise to kernel matrices of size $nd \times nd$ for $n$ observations in $d$ dimensions.

Bayesian Optimization

Automating Crystal-Structure Phase Mapping: Combining Deep Learning with Constraint Reasoning

no code implementations21 Aug 2021 Di Chen, Yiwei Bai, Sebastian Ament, Wenting Zhao, Dan Guevarra, Lan Zhou, Bart Selman, R. Bruce van Dover, John M. Gregoire, Carla P. Gomes

DRNets compensate for the limited data by exploiting and magnifying the rich prior knowledge about the thermodynamic rules governing the mixtures of crystals with constraint reasoning seamlessly integrated into neural network optimization.

Sparse Bayesian Learning via Stepwise Regression

1 code implementation11 Jun 2021 Sebastian Ament, Carla Gomes

Herein, we propose a coordinate ascent algorithm for SBL termed Relevance Matching Pursuit (RMP) and show that, as its noise variance parameter goes to zero, RMP exhibits a surprising connection to Stepwise Regression.

feature selection regression

The Fast Kernel Transform

1 code implementation8 Jun 2021 John Paul Ryan, Sebastian Ament, Carla P. Gomes, Anil Damle

Kernel methods are a highly effective and widely used collection of modern machine learning algorithms.

Gaussian Processes

Efficient Projection Algorithms onto the Weighted l1 Ball

no code implementations7 Sep 2020 Guillaume Perez, Sebastian Ament, Carla Gomes, Michel Barlaud

In this paper we propose three new efficient algorithms for projecting any vector of finite length onto the weighted $\ell_1$ ball.

BIG-bench Machine Learning feature selection

Deep Reasoning Networks: Thinking Fast and Slow, for Pattern De-mixing

no code implementations25 Sep 2019 Di Chen, Yiwei Bai, Wenting Zhao, Sebastian Ament, John M. Gregoire, Carla P. Gomes

We introduce Deep Reasoning Networks (DRNets), an end-to-end framework that combines deep learning with reasoning for solving pattern de-mixing problems, typically in an unsupervised or weakly-supervised setting.

Deep Reasoning Networks: Thinking Fast and Slow

no code implementations3 Jun 2019 Di Chen, Yiwei Bai, Wenting Zhao, Sebastian Ament, John M. Gregoire, Carla P. Gomes

At a high level, DRNets encode a structured latent space of the input data, which is constrained to adhere to prior knowledge by a reasoning module.

Exponentially-Modified Gaussian Mixture Model: Applications in Spectroscopy

no code implementations14 Feb 2019 Sebastian Ament, John Gregoire, Carla Gomes

In particular, we demonstrate the effectiveness of PMF in conjunction with the EMG mixture model on synthetic data and two real-world applications: X-ray diffraction and Raman spectroscopy.

regression

Cannot find the paper you are looking for? You can Submit a new open access paper.