Search Results for author: Thomas Pierrot

Found 23 papers, 11 papers with code

Preference-Conditioned Gradient Variations for Multi-Objective Quality-Diversity

no code implementations19 Nov 2024 Hannah Janmohamed, Maxence Faldor, Thomas Pierrot, Antoine Cully

In a variety of domains, from robotics to finance, Quality-Diversity algorithms have been used to generate collections of both diverse and high-performing solutions.

Diversity

Multi-modal Transfer Learning between Biological Foundation Models

no code implementations20 Jun 2024 Juan Jose Garau-Luis, Patrick Bordes, Liam Gonzalez, Masa Roller, Bernardo P. de Almeida, Lorenz Hexemer, Christopher Blum, Stefan Laurent, Jan Grzegorzewski, Maren Lang, Thomas Pierrot, Guillaume Richard

We demonstrate its capabilities by applying it to the largely unsolved problem of predicting how multiple RNA transcript isoforms originate from the same gene (i. e. same DNA sequence) and map to different transcription expression levels across various human tissues.

Transfer Learning

Learning the Language of Protein Structure

1 code implementation24 May 2024 Benoit Gaujac, Jérémie Donà, Liviu Copoiu, Timothy Atkinson, Thomas Pierrot, Thomas D. Barrett

Representation learning and \emph{de novo} generation of proteins are pivotal computational biology tasks.

Protein Design Representation Learning

Multi-Objective Quality-Diversity for Crystal Structure Prediction

1 code implementation25 Mar 2024 Hannah Janmohamed, Marta Wolinska, Shikha Surana, Thomas Pierrot, Aron Walsh, Antoine Cully

This approach overlooks other potentially interesting materials that lie in neighbouring local minima and have different material properties such as conductivity or resistance to deformation.

Diversity Prediction

PASTA: Pretrained Action-State Transformer Agents

no code implementations20 Jul 2023 Raphael Boige, Yannis Flet-Berliac, Arthur Flajolet, Guillaume Richard, Thomas Pierrot

Self-supervised learning has brought about a revolutionary paradigm shift in various computing domains, including NLP, vision, and biology.

Language Modeling Language Modelling +4

Gradient-Informed Quality Diversity for the Illumination of Discrete Spaces

no code implementations8 Jun 2023 Raphael Boige, Guillaume Richard, Jérémie Dona, Thomas Pierrot, Antoine Cully

While early QD algorithms view the objective and descriptor functions as black-box functions, novel tools have been introduced to use gradient information to accelerate the search and improve overall performance of those algorithms over continuous input spaces.

Diversity Drug Discovery +2

The Quality-Diversity Transformer: Generating Behavior-Conditioned Trajectories with Decision Transformers

no code implementations27 Mar 2023 Valentin Macé, Raphaël Boige, Felix Chalumeau, Thomas Pierrot, Guillaume Richard, Nicolas Perrin-Gilbert

In the context of neuroevolution, Quality-Diversity algorithms have proven effective in generating repertoires of diverse and efficient policies by relying on the definition of a behavior space.

Diversity

Evolving Populations of Diverse RL Agents with MAP-Elites

1 code implementation9 Mar 2023 Thomas Pierrot, Arthur Flajolet

Quality Diversity (QD) has emerged as a powerful alternative optimization paradigm that aims at generating large and diverse collections of solutions, notably with its flagship algorithm MAP-ELITES (ME) which evolves solutions through mutations and crossovers.

Reinforcement Learning (RL)

Improving the Data Efficiency of Multi-Objective Quality-Diversity through Gradient Assistance and Crowding Exploration

1 code implementation24 Feb 2023 Hannah Janmohamed, Thomas Pierrot, Antoine Cully

We show that MOME-PGX is between 4. 3 and 42 times more data-efficient than MOME and doubles the performance of MOME, NSGA-II and SPEA2 in challenging environments.

Diversity Evolutionary Algorithms

Assessing Quality-Diversity Neuro-Evolution Algorithms Performance in Hard Exploration Problems

no code implementations24 Nov 2022 Felix Chalumeau, Thomas Pierrot, Valentin Macé, Arthur Flajolet, Karim Beguir, Antoine Cully, Nicolas Perrin-Gilbert

Exploration is at the heart of several domains trying to solve control problems such as Reinforcement Learning and QD methods are promising candidates to overcome the challenges associated.

Diversity Evolutionary Algorithms

Neuroevolution is a Competitive Alternative to Reinforcement Learning for Skill Discovery

1 code implementation6 Oct 2022 Felix Chalumeau, Raphael Boige, Bryan Lim, Valentin Macé, Maxime Allard, Arthur Flajolet, Antoine Cully, Thomas Pierrot

Recent work has shown that training a mixture of policies, as opposed to a single one, that are driven to explore different regions of the state-action space can address this shortcoming by generating a diverse set of behaviors, referred to as skills, that can be collectively used to great effect in adaptation tasks or for hierarchical planning.

Deep Reinforcement Learning Diversity +2

Fast Population-Based Reinforcement Learning on a Single Machine

1 code implementation17 Jun 2022 Arthur Flajolet, Claire Bizon Monroc, Karim Beguir, Thomas Pierrot

Training populations of agents has demonstrated great promise in Reinforcement Learning for stabilizing training, improving exploration and asymptotic performance, and generating a diverse set of solutions.

reinforcement-learning Reinforcement Learning +1

Multi-Objective Quality Diversity Optimization

1 code implementation7 Feb 2022 Thomas Pierrot, Guillaume Richard, Karim Beguir, Antoine Cully

In this work, we consider the problem of Quality-Diversity (QD) optimization with multiple objectives.

Diversity

Sample efficient Quality Diversity for neural continuous control

no code implementations1 Jan 2021 Thomas Pierrot, Valentin Macé, Geoffrey Cideron, Nicolas Perrin, Karim Beguir, Olivier Sigaud

The QD part contributes structural biases by decoupling the search for diversity from the search for high return, resulting in efficient management of the exploration-exploitation trade-off.

continuous-control Continuous Control +3

Designing a Prospective COVID-19 Therapeutic with Reinforcement Learning

no code implementations3 Dec 2020 Marcin J. Skwark, Nicolás López Carranza, Thomas Pierrot, Joe Phillips, Slim Said, Alexandre Laterre, Amine Kerkeni, Uğur Şahin, Karim Beguir

This suggests that combining leading protein design methods with modern deep reinforcement learning is a viable path for discovering a Covid-19 cure and may accelerate design of peptide-based therapeutics for other diseases.

Deep Reinforcement Learning Protein Design +2

Offline Reinforcement Learning Hands-On

no code implementations29 Nov 2020 Louis Monier, Jakub Kmec, Alexandre Laterre, Thomas Pierrot, Valentin Courgeau, Olivier Sigaud, Karim Beguir

Offline Reinforcement Learning (RL) aims to turn large datasets into powerful decision-making engines without any online interactions with the environment.

Behavioural cloning Decision Making +5

Diversity Policy Gradient for Sample Efficient Quality-Diversity Optimization

1 code implementation NeurIPS 2021 Thomas Pierrot, Valentin Macé, Félix Chalumeau, Arthur Flajolet, Geoffrey Cideron, Karim Beguir, Antoine Cully, Olivier Sigaud, Nicolas Perrin-Gilbert

This paper proposes a novel algorithm, QDPG, which combines the strength of Policy Gradient algorithms and Quality Diversity approaches to produce a collection of diverse and high-performing neural policies in continuous control environments.

continuous-control Continuous Control +2

First-order and second-order variants of the gradient descent in a unified framework

no code implementations18 Oct 2018 Thomas Pierrot, Nicolas Perrin, Olivier Sigaud

In this paper, we provide an overview of first-order and second-order variants of the gradient descent method that are commonly used in machine learning.

BIG-bench Machine Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.