Search Results for author: Matthew C. Fontaine

Found 21 papers, 16 papers with code

Quality-Diversity Generative Sampling for Learning with Synthetic Data

1 code implementation22 Dec 2023 Allen Chang, Matthew C. Fontaine, Serena Booth, Maja J. Matarić, Stefanos Nikolaidis

QDGS is a model-agnostic framework that uses prompt guidance to optimize a quality objective across measures of diversity for synthetically generated data, without fine-tuning the generative model.

Fairness

Density Descent for Diversity Optimization

no code implementations18 Dec 2023 David H. Lee, Anishalakshmi V. Palaparthi, Matthew C. Fontaine, Bryon Tjanaka, Stefanos Nikolaidis

We propose Density Descent Search (DDS), an algorithm that explores the feature space via gradient descent on a continuous density estimate of the feature space that also provides stronger stability guarantee.

Density Estimation

Arbitrarily Scalable Environment Generators via Neural Cellular Automata

1 code implementation NeurIPS 2023 Yulun Zhang, Matthew C. Fontaine, Varun Bhatt, Stefanos Nikolaidis, Jiaoyang Li

We show that NCA environment generators maintain consistent, regularized patterns regardless of environment size, significantly enhancing the scalability of multi-robot systems in two different domains with up to 2, 350 robots.

Proximal Policy Gradient Arborescence for Quality Diversity Reinforcement Learning

no code implementations23 May 2023 Sumeet Batra, Bryon Tjanaka, Matthew C. Fontaine, Aleksei Petrenko, Stefanos Nikolaidis, Gaurav Sukhatme

Training generally capable agents that thoroughly explore their environment and learn new and diverse skills is a long-term goal of robot learning.

reinforcement-learning Reinforcement Learning (RL)

Multi-Robot Coordination and Layout Design for Automated Warehousing

1 code implementation10 May 2023 Yulun Zhang, Matthew C. Fontaine, Varun Bhatt, Stefanos Nikolaidis, Jiaoyang Li

We show that, even with state-of-the-art MAPF algorithms, commonly used human-designed layouts can lead to congestion for warehouses with large numbers of robots and thus have limited scalability.

Layout Design Multi-Agent Path Finding

Surrogate Assisted Generation of Human-Robot Interaction Scenarios

1 code implementation26 Apr 2023 Varun Bhatt, Heramb Nemlekar, Matthew C. Fontaine, Bryon Tjanaka, Hejia Zhang, Ya-Chuan Hsu, Stefanos Nikolaidis

In the shared control teleoperation domain and a more complex shared workspace collaboration task, we show that surrogate assisted scenario generation efficiently synthesizes diverse datasets of challenging scenarios.

pyribs: A Bare-Bones Python Library for Quality Diversity Optimization

1 code implementation1 Mar 2023 Bryon Tjanaka, Matthew C. Fontaine, David H. Lee, Yulun Zhang, Nivedit Reddy Balam, Nathaniel Dennler, Sujay S. Garlanka, Nikitas Dimitri Klapsis, Stefanos Nikolaidis

Recent years have seen a rise in the popularity of quality diversity (QD) optimization, a branch of optimization that seeks to find a collection of diverse, high-performing solutions to a given problem.

Training Diverse High-Dimensional Controllers by Scaling Covariance Matrix Adaptation MAP-Annealing

1 code implementation6 Oct 2022 Bryon Tjanaka, Matthew C. Fontaine, David H. Lee, Aniruddha Kalkar, Stefanos Nikolaidis

Pre-training a diverse set of neural network controllers in simulation has enabled robots to adapt online to damage in robot locomotion tasks.

Generating Diverse Indoor Furniture Arrangements

no code implementations20 Jun 2022 Ya-Chuan Hsu, Matthew C. Fontaine, Sam Earle, Maria Edwards, Julian Togelius, Stefanos Nikolaidis

To target specific diversity in the arrangements, we optimize the latent space of the GAN via a quality diversity algorithm to generate a diverse arrangement collection.

Generative Adversarial Network

Deep Surrogate Assisted Generation of Environments

no code implementations9 Jun 2022 Varun Bhatt, Bryon Tjanaka, Matthew C. Fontaine, Stefanos Nikolaidis

Results in two benchmark domains show that DSAGE significantly outperforms existing QD environment generation algorithms in discovering collections of environments that elicit diverse behaviors of a state-of-the-art RL agent and a planning agent.

Reinforcement Learning (RL)

Covariance Matrix Adaptation MAP-Annealing

1 code implementation22 May 2022 Matthew C. Fontaine, Stefanos Nikolaidis

Quality diversity (QD) optimization algorithms, such as Covariance Matrix Adaptation MAP-Elites (CMA-ME), search for a collection of solutions that are both high-quality with respect to an objective and diverse with respect to specified measure functions.

Approximating Gradients for Differentiable Quality Diversity in Reinforcement Learning

1 code implementation8 Feb 2022 Bryon Tjanaka, Matthew C. Fontaine, Julian Togelius, Stefanos Nikolaidis

Training can then be viewed as a quality diversity (QD) optimization problem, where we search for a collection of performant policies that are diverse with respect to quantified behavior.

reinforcement-learning Reinforcement Learning (RL)

Deep Surrogate Assisted MAP-Elites for Automated Hearthstone Deckbuilding

1 code implementation7 Dec 2021 Yulun Zhang, Matthew C. Fontaine, Amy K. Hoover, Stefanos Nikolaidis

In a Hearthstone deckbuilding case study, we show that our approach improves the sample efficiency of MAP-Elites and outperforms a model trained offline with random decks, as well as a linear surrogate model baseline, setting a new state-of-the-art for quality diversity approaches in automated Hearthstone deckbuilding.

Illuminating Diverse Neural Cellular Automata for Level Generation

2 code implementations12 Sep 2021 Sam Earle, Justin Snider, Matthew C. Fontaine, Stefanos Nikolaidis, Julian Togelius

We present a method of generating diverse collections of neural cellular automata (NCA) to design video game levels.

On the Importance of Environments in Human-Robot Coordination

1 code implementation21 Jun 2021 Matthew C. Fontaine, Ya-Chuan Hsu, Yulun Zhang, Bryon Tjanaka, Stefanos Nikolaidis

When studying robots collaborating with humans, much of the focus has been on robot policies that coordinate fluently with human teammates in collaborative tasks.

Differentiable Quality Diversity

2 code implementations NeurIPS 2021 Matthew C. Fontaine, Stefanos Nikolaidis

Quality diversity (QD) is a growing branch of stochastic optimization research that studies the problem of generating an archive of solutions that maximize a given objective function but are also diverse with respect to a set of specified measure functions.

Stochastic Optimization

Video Game Level Repair via Mixed Integer Linear Programming

1 code implementation13 Oct 2020 Hejia Zhang, Matthew C. Fontaine, Amy K. Hoover, Julian Togelius, Bistra Dilkina, Stefanos Nikolaidis

Recent advancements in procedural content generation via machine learning enable the generation of video-game levels that are aesthetically similar to human-authored examples.

Generative Adversarial Network

Covariance Matrix Adaptation for the Rapid Illumination of Behavior Space

6 code implementations5 Dec 2019 Matthew C. Fontaine, Julian Togelius, Stefanos Nikolaidis, Amy K. Hoover

Results from experiments based on standard continuous optimization benchmarks show that CMA-ME finds better-quality solutions than MAP-Elites; similarly, results on the strategic game Hearthstone show that CMA-ME finds both a higher overall quality and broader diversity of strategies than both CMA-ES and MAP-Elites.

Evolving the Hearthstone Meta

no code implementations2 Jul 2019 Fernando de Mesentier Silva, Rodrigo Canaan, Scott Lee, Matthew C. Fontaine, Julian Togelius, Amy K. Hoover

Balancing an ever growing strategic game of high complexity, such as Hearthstone is a complex task.

Mapping Hearthstone Deck Spaces through MAP-Elites with Sliding Boundaries

1 code implementation24 Apr 2019 Matthew C. Fontaine, Scott Lee, L. B. Soros, Fernando De Mesentier Silva, Julian Togelius, Amy K. Hoover

Quality diversity (QD) algorithms such as MAP-Elites have emerged as a powerful alternative to traditional single-objective optimization methods.

Cannot find the paper you are looking for? You can Submit a new open access paper.