1 code implementation • 20 Sep 2024 • Manon Flageat, Hannah Janmohamed, Bryan Lim, Antoine Cully
As this is a trade-off, neither one of these two solutions is "better" than the other.
no code implementations • 24 Apr 2024 • Bryan Lim, Manon Flageat, Antoine Cully
We introduce In-context QD, a framework of techniques that aim to elicit the in-context capabilities of pre-trained Large Language Models (LLMs) to generate interesting solutions using few-shot and many-shot prompting with quality-diverse examples from the QD archive as context.
no code implementations • 12 Dec 2023 • Manon Flageat, Bryan Lim, Antoine Cully
We highlight that existing procedures that only use the expected return are limited on two fronts: first an infinite number of return distributions with a wide range of performance-reproducibility trade-offs can have the same expected return, limiting its effectiveness when used for comparing policies; second, the expected return metric does not leave any room for practitioners to choose the best trade-off value for considered applications.
2 code implementations • 10 Dec 2023 • Maxence Faldor, Félix Chalumeau, Manon Flageat, Antoine Cully
In this work, we introduce DCRL-MAP-Elites, an extension of DCG-MAP-Elites that utilizes the descriptor-conditioned actor as a generative model to produce diverse solutions, which are then injected into the offspring batch at each generation.
no code implementations • 3 Nov 2023 • Garðar Ingvarsson, Mikayel Samvelyan, Bryan Lim, Manon Flageat, Antoine Cully, Tim Rocktäschel
In many real-world systems, such as adaptive robotics, achieving a single, optimised solution may be insufficient.
1 code implementation • 7 Aug 2023 • Felix Chalumeau, Bryan Lim, Raphael Boige, Maxime Allard, Luca Grillotti, Manon Flageat, Valentin Macé, Arthur Flajolet, Thomas Pierrot, Antoine Cully
QDax is an open-source library with a streamlined and modular API for Quality-Diversity (QD) optimization algorithms in Jax.
1 code implementation • 24 Apr 2023 • Manon Flageat, Luca Grillotti, Antoine Cully
In this paper, we propose a first set of benchmark tasks to analyse and estimate the performance of UQD algorithms.
no code implementations • 7 Apr 2023 • Luca Grillotti, Manon Flageat, Bryan Lim, Antoine Cully
Quality-Diversity (QD) algorithms are designed to generate collections of high-performing solutions while maximizing their diversity in a given descriptor space.
no code implementations • 10 Mar 2023 • Bryan Lim, Manon Flageat, Antoine Cully
However, we also find that not all insights from Deep RL can be effectively translated to QD-RL.
1 code implementation • 10 Mar 2023 • Manon Flageat, Bryan Lim, Antoine Cully
With the development of fast and massively parallel evaluations in many domains, Quality-Diversity (QD) algorithms, that already proved promising in a large range of applications, have seen their potential multiplied.
1 code implementation • 7 Mar 2023 • Maxence Faldor, Félix Chalumeau, Manon Flageat, Antoine Cully
Quality-Diversity algorithms, such as MAP-Elites, are a branch of Evolutionary Computation generating collections of diverse and high-performing solutions, that have been successfully applied to a variety of domains and particularly in evolutionary robotics.
1 code implementation • 1 Feb 2023 • Manon Flageat, Antoine Cully
Second, we propose a new methodology to evaluate Uncertain QD approaches, relying on a new per-generation sampling budget and a set of existing and new metrics specifically designed for Uncertain QD.
no code implementations • 22 Nov 2022 • Bryan Lim, Manon Flageat, Antoine Cully
Methods such as Quality-Diversity deals with this by encouraging novel solutions and producing a diversity of behaviours.
1 code implementation • 4 Nov 2022 • Manon Flageat, Bryan Lim, Luca Grillotti, Maxime Allard, Simón C. Smith, Antoine Cully
We present a Quality-Diversity benchmark suite for Deep Neuroevolution in Reinforcement Learning domains for robot control.
1 code implementation • 24 Oct 2022 • Manon Flageat, Felix Chalumeau, Antoine Cully
Secondly, we show that in addition to outperforming all the considered baselines, the collections of solutions generated by PGA-MAP-Elites are highly reproducible in uncertain environments, approaching the reproducibility of solutions found by Quality-Diversity approaches built specifically for uncertain applications.
1 code implementation • 25 Jun 2020 • Manon Flageat, Antoine Cully
It therefore finds many applications in real-world domain problems such as robotic control.