Search Results for author: Amanda Prorok

Found 37 papers, 22 papers with code

Heterogeneous Multi-Robot Reinforcement Learning

2 code implementations17 Jan 2023 Matteo Bettini, Ajay Shankar, Amanda Prorok

Through simulations and real-world experiments, we show that: (i) when homogeneous methods fail due to strong heterogeneous requirements, HetGPPO succeeds, and, (ii) when homogeneous methods are able to learn apparently heterogeneous behaviors, HetGPPO achieves higher resilience to both training and deployment noise.

Multi-agent Reinforcement Learning reinforcement-learning +1

Graph Neural Networks for Decentralized Multi-Robot Path Planning

1 code implementation12 Dec 2019 Qing-Biao Li, Fernando Gama, Alejandro Ribeiro, Amanda Prorok

We train the model to imitate an expert algorithm, and use the resulting model online in decentralized planning involving only local communication and local observations.

Decision Making

BenchMARL: Benchmarking Multi-Agent Reinforcement Learning

1 code implementation3 Dec 2023 Matteo Bettini, Amanda Prorok, Vincent Moens

The field of Multi-Agent Reinforcement Learning (MARL) is currently facing a reproducibility crisis.

Benchmarking Multi-agent Reinforcement Learning +2

Message-Aware Graph Attention Networks for Large-Scale Multi-Robot Path Planning

1 code implementation26 Nov 2020 QingBiao Li, Weizhe Lin, Zhe Liu, Amanda Prorok

Our Message-Aware Graph Attention neTwork (MAGAT) is based on a key-query-like mechanism that determines the relative importance of features in the messages received from various neighboring robots.

Graph Attention

Mobile Robot Path Planning in Dynamic Environments through Globally Guided Reinforcement Learning

1 code implementation11 May 2020 Binyu Wang, Zhe Liu, Qing-Biao Li, Amanda Prorok

Path planning for mobile robots in large dynamic environments is a challenging problem, as the robots are required to efficiently reach their given goals while simultaneously avoiding potential conflicts with other robots or dynamic objects.

reinforcement-learning Reinforcement Learning (RL)

A Framework for Real-World Multi-Robot Systems Running Decentralized GNN-Based Policies

2 code implementations2 Nov 2021 Jan Blumenkamp, Steven Morad, Jennifer Gielis, QingBiao Li, Amanda Prorok

We demonstrate our framework on a case-study that requires tight coordination between robots, and present first-of-a-kind results that show successful real-world deployment of GNN-based policies on a decentralized multi-robot system relying on Adhoc communication.

The Emergence of Adversarial Communication in Multi-Agent Reinforcement Learning

1 code implementation6 Aug 2020 Jan Blumenkamp, Amanda Prorok

Such a design choice, however, precludes the existence of a single, differentiable communication channel, and consequently prohibits the learning of inter-agent communication strategies.

Multi-agent Reinforcement Learning reinforcement-learning +1

System Neural Diversity: Measuring Behavioral Heterogeneity in Multi-Agent Learning

1 code implementation3 May 2023 Matteo Bettini, Ajay Shankar, Amanda Prorok

When a system of learning agents is not constrained to homogeneous policies, individual agents may develop diverse behaviors, resulting in emergent complementarity that benefits the system.

Multi-agent Reinforcement Learning

Graph Neural Network Guided Local Search for the Traveling Salesperson Problem

1 code implementation ICLR 2022 Benjamin Hudson, QingBiao Li, Matthew Malencia, Amanda Prorok

To close this gap, we present a hybrid data-driven approach for solving the TSP based on Graph Neural Networks (GNNs) and Guided Local Search (GLS).

Graph Neural Networks for Decentralized Multi-Robot Submodular Action Selection

1 code implementation18 May 2021 Lifeng Zhou, Vishnu D. Sharma, QingBiao Li, Amanda Prorok, Alejandro Ribeiro, Pratap Tokekar, Vijay Kumar

We demonstrate the performance of our GNN-based learning approach in a scenario of active target tracking with large networks of robots.

Decision Making Motion Planning

Graph Convolutional Memory using Topological Priors

1 code implementation27 Jun 2021 Steven D. Morad, Stephan Liwicki, Ryan Kortvelesy, Roberto Mecca, Amanda Prorok

Solving partially-observable Markov decision processes (POMDPs) is critical when applying reinforcement learning to real-world problems, where agents have an incomplete view of the world.

Memorization reinforcement-learning +1

ModGNN: Expert Policy Approximation in Multi-Agent Systems with a Modular Graph Neural Network Architecture

1 code implementation24 Mar 2021 Ryan Kortvelesy, Amanda Prorok

Recent work in the multi-agent domain has shown the promise of Graph Neural Networks (GNNs) to learn complex coordination strategies.

An Adversarial Approach to Private Flocking in Mobile Robot Teams

2 code implementations23 Sep 2019 Hehui Zheng, Jacopo Panerati, Giovanni Beltrame, Amanda Prorok

We present a method that generates private flocking controllers that hide the identity of the leader robot.

Motion Planning

QGNN: Value Function Factorisation with Graph Neural Networks

1 code implementation25 May 2022 Ryan Kortvelesy, Amanda Prorok

In multi-agent reinforcement learning, the use of a global objective is a powerful tool for incentivising cooperation.

Multi-agent Reinforcement Learning Starcraft

Permutation-Invariant Set Autoencoders with Fixed-Size Embeddings for Multi-Agent Learning

2 code implementations24 Feb 2023 Ryan Kortvelesy, Steven Morad, Amanda Prorok

The problem of permutation-invariant learning over set representations is particularly relevant in the field of multi-agent systems -- a few potential applications include unsupervised training of aggregation functions in graph neural networks (GNNs), neural cellular automata on graphs, and prediction of scenes with multiple objects.

Generalising Multi-Agent Cooperation through Task-Agnostic Communication

1 code implementation11 Mar 2024 Dulhan Jayalath, Steven Morad, Amanda Prorok

Our objective is to learn a fixed-size latent Markov state from a variable number of agent observations.

Multi-agent Reinforcement Learning

Explanation-Aware Experience Replay in Rule-Dense Environments

1 code implementation29 Sep 2021 Francesco Sovrano, Alex Raymond, Amanda Prorok

In this paper, we propose a method for organising experience by means of partitioning the experience buffer into clusters labelled on a per-explanation basis.

Autonomous Driving Reinforcement Learning (RL)

Differentially Private Decentralized Deep Learning with Consensus Algorithms

1 code implementation24 Jun 2023 Jasmine Bayrooti, Zhan Gao, Amanda Prorok

Furthermore, we show that it is possible to learn a model achieving high accuracies, within 3% of DP-SGD on MNIST under (1, 10^-5)-differential privacy and within 6% of DP-SGD on CIFAR-100 under (10, 10^-5)-differential privacy, without ever sharing raw data with other agents.

Graph Neural Networks for Learning Robot Team Coordination

no code implementations9 May 2018 Amanda Prorok

This paper shows how Graph Neural Networks can be used for learning distributed coordination mechanisms in connected teams of robots.

Multi-Vehicle Mixed-Reality Reinforcement Learning for Autonomous Multi-Lane Driving

no code implementations26 Nov 2019 Rupert Mitchell, Jenny Fletcher, Jacopo Panerati, Amanda Prorok

In this article, we present a safe and efficient framework that enables the learning of driving policies for autonomous vehicles operating in a shared workspace, where the absence of collisions cannot be guaranteed.

Autonomous Driving Mixed Reality +2

Gaussian Process Based Message Filtering for Robust Multi-Agent Cooperation in the Presence of Adversarial Communication

no code implementations1 Dec 2020 Rupert Mitchell, Jan Blumenkamp, Amanda Prorok

In this paper, we consider the problem of providing robustness to adversarial communication in multi-agent systems.

Synthesizing Decentralized Controllers with Graph Neural Networks and Imitation Learning

no code implementations29 Dec 2020 Fernando Gama, QingBiao Li, Ekaterina Tolstaya, Amanda Prorok, Alejandro Ribeiro

Dynamical systems consisting of a set of autonomous agents face the challenge of having to accomplish a global task, relying only on local information.

Imitation Learning

The Holy Grail of Multi-Robot Planning: Learning to Generate Online-Scalable Solutions from Offline-Optimal Experts

no code implementations26 Jul 2021 Amanda Prorok, Jan Blumenkamp, QingBiao Li, Ryan Kortvelesy, Zhe Liu, Ethan Stump

Many multi-robot planning problems are burdened by the curse of dimensionality, which compounds the difficulty of applying solutions to large-scale problem instances.

Beyond Robustness: A Taxonomy of Approaches towards Resilient Multi-Robot Systems

no code implementations25 Sep 2021 Amanda Prorok, Matthew Malencia, Luca Carlone, Gaurav S. Sukhatme, Brian M. Sadler, Vijay Kumar

In this survey article, we analyze how resilience is achieved in networks of agents and multi-robot systems that are able to overcome adversity by leveraging system-wide complementarity, diversity, and redundancy - often involving a reconfiguration of robotic capabilities to provide some key ability that was not present in the system a priori.

See What the Robot Can't See: Learning Cooperative Perception for Visual Navigation

no code implementations1 Aug 2022 Jan Blumenkamp, QingBiao Li, Binyu Wang, Zhe Liu, Amanda Prorok

We consider the problem of navigating a mobile robot towards a target in an unknown environment that is endowed with visual sensors, where neither the robot nor the sensors have access to global positioning information and only use first-person-view images.

Imitation Learning Navigate +1

Environment Optimization for Multi-Agent Navigation

no code implementations22 Sep 2022 Zhan Gao, Amanda Prorok

Traditional approaches to the design of multi-agent navigation algorithms consider the environment as a fixed constraint, despite the obvious influence of spatial constraints on agents' performance.

Decentralized Channel Management in WLANs with Graph Neural Networks

no code implementations30 Oct 2022 Zhan Gao, Yulin Shao, Deniz Gunduz, Amanda Prorok

Wireless local area networks (WLANs) manage multiple access points (APs) and assign scarce radio frequency resources to APs for satisfying traffic demands of associated user devices.

Management

Online Control Barrier Functions for Decentralized Multi-Agent Navigation

no code implementations8 Mar 2023 Zhan Gao, Guang Yang, Amanda Prorok

Control barrier functions (CBFs) enable guaranteed safe multi-agent navigation in the continuous domain.

Robot Navigation

Constrained Environment Optimization for Prioritized Multi-Agent Navigation

no code implementations18 May 2023 Zhan Gao, Amanda Prorok

The goal of this paper is to consider the environment as a decision variable in a system-level optimization problem, where both agent performance and environment cost are incorporated.

Stochastic Optimization

Docking Multirotors in Close Proximity using Learnt Downwash Models

no code implementations23 Nov 2023 Ajay Shankar, Heedo Woo, Amanda Prorok

However, certain missions \textit{require} two multirotors to approach each other within 1-2 body-lengths of each other and hold formation -- we consider one such practical instance: vertically docking two multirotors in the air.

On the Trade-Off between Stability and Representational Capacity in Graph Neural Networks

no code implementations4 Dec 2023 Zhan Gao, Amanda Prorok, Elvin Isufi

Analyzing the stability of graph neural networks (GNNs) under topological perturbations is key to understanding their transferability and the role of each architecture component.

Revisiting Recurrent Reinforcement Learning with Memory Monoids

1 code implementation15 Feb 2024 Steven Morad, Chris Lu, Ryan Kortvelesy, Stephan Liwicki, Jakob Foerster, Amanda Prorok

Memory models such as Recurrent Neural Networks (RNNs) and Transformers address Partially Observable Markov Decision Processes (POMDPs) by mapping trajectories to latent Markov states.

reinforcement-learning

Co-Optimization of Environment and Policies for Decentralized Multi-Agent Navigation

no code implementations21 Mar 2024 Zhan Gao, Guang Yang, Amanda Prorok

By introducing two sub-objectives of multi-agent navigation and environment optimization, we propose an $\textit{agent-environment co-optimization}$ problem and develop a $\textit{coordinated algorithm}$ that alternates between these sub-objectives to search for an optimal synthesis of agent actions and obstacle configurations in the environment; ultimately, improving the navigation performance.

Cannot find the paper you are looking for? You can Submit a new open access paper.