Search Results for author: Matthew Gombolay

Found 39 papers, 18 papers with code

Mixed-Initiative Human-Robot Teaming under Suboptimality with Online Bayesian Adaptation

1 code implementation24 Mar 2024 Manisha Natarajan, Chunyue Xue, Sanne van Waveren, Karen Feigh, Matthew Gombolay

For effective human-agent teaming, robots and other artificial intelligence (AI) agents must infer their human partner's abilities and behavioral response patterns and adapt accordingly.

Decision Making

Multi-Camera Asynchronous Ball Localization and Trajectory Prediction with Factor Graphs and Human Poses

no code implementations30 Jan 2024 Qingyu Xiao, Zulfiqar Zaidi, Matthew Gombolay

The rapid and precise localization and prediction of a ball are critical for developing agile robots in ball sports, particularly in sports like tennis characterized by high-speed ball movements and powerful spins.

Trajectory Prediction

Diffusion Models for Multi-target Adversarial Tracking

1 code implementation12 Jul 2023 Sean Ye, Manisha Natarajan, Zixuan Wu, Matthew Gombolay

Target tracking plays a crucial role in real-world scenarios, particularly in drug-trafficking interdiction, where the knowledge of an adversarial target's location is often limited.

Learning Coordination Policies over Heterogeneous Graphs for Human-Robot Teams via Recurrent Neural Schedule Propagation

1 code implementation30 Jan 2023 Batuhan Altundas, Zheyuan Wang, Joshua Bishop, Matthew Gombolay

We propose a deep learning-based framework, called HybridNet, combining a heterogeneous graph-based encoder with a recurrent schedule propagator for scheduling stochastic human-robot teams under upper- and lower-bound temporal constraints.

Decision Making Graph Attention +1

Towards the design of user-centric strategy recommendation systems for collaborative Human-AI tasks

no code implementations17 Jan 2023 Lakshita Dodeja, Pradyumna Tambwekar, Erin Hedlund-Botti, Matthew Gombolay

While these strategy recommendation schemes have been explored independently in prior work, our study is novel in that we employ all of them simultaneously and in the context of strategy recommendations, to provide us an in-depth overview of the perception of different strategy recommendation systems.

Decision Making Recommendation Systems

Towards Reconciling Usability and Usefulness of Explainable AI Methodologies

no code implementations13 Jan 2023 Pradyumna Tambwekar, Matthew Gombolay

Our findings highlight internal consistency issues wherein participants perceived language explanations to be significantly more usable, however participants were better able to objectively understand the decision making process of the car through a decision tree explanation.

Decision Making Explainable Artificial Intelligence (XAI) +1

Safe Inverse Reinforcement Learning via Control Barrier Function

no code implementations6 Dec 2022 Yue Yang, Letian Chen, Matthew Gombolay

Learning from Demonstration (LfD) is a powerful method for enabling robots to perform novel tasks as it is often more tractable for a non-roboticist end-user to demonstrate the desired skill and for the robot to efficiently learn from the associated data than for a human to engineer a reward function for the robot to learn the skill via reinforcement learning (RL).

reinforcement-learning Reinforcement Learning (RL)

FedPC: Federated Learning for Language Generation with Personal and Context Preference Embeddings

no code implementations7 Oct 2022 Andrew Silva, Pradyumna Tambwekar, Matthew Gombolay

Federated learning is a training paradigm that learns from multiple distributed users without aggregating data on a centralized server.

Federated Learning Text Generation

Fast Lifelong Adaptive Inverse Reinforcement Learning from Demonstrations

no code implementations24 Sep 2022 Letian Chen, Sravan Jayanthi, Rohan Paleja, Daniel Martin, Viacheslav Zakharov, Matthew Gombolay

Learning from Demonstration (LfD) approaches empower end-users to teach robots novel tasks via demonstrations of the desired behaviors, democratizing access to robotics.

Continuous Control reinforcement-learning +1

The Utility of Explainable AI in Ad Hoc Human-Machine Teaming

1 code implementation NeurIPS 2021 Rohan Paleja, Muyleng Ghuy, Nadun Ranawaka Arachchige, Reed Jensen, Matthew Gombolay

On the other hand, expert performance degrades with the addition of xAI-based support ($p<0. 05$), indicating that the cost of paying attention to the xAI outweighs the benefits obtained from being provided additional information to enhance SA.

Decision Making Explainable Artificial Intelligence (XAI)

A Computational Interface to Translate Strategic Intent from Unstructured Language in a Low-Data Setting

1 code implementation17 Aug 2022 Pradyumna Tambwekar, Lakshita Dodeja, Nathan Vaska, Wei Xu, Matthew Gombolay

Leveraging a game environment, we collect a dataset of over 1000 examples, mapping language strategies to the corresponding goals and constraints, and show that our model, trained on this dataset, significantly outperforms human interpreters in inferring strategic intent (i. e., goals and constraints) from language (p < 0. 05).

Machine Translation

Robots Enact Malignant Stereotypes

no code implementations23 Jul 2022 Andrew Hundt, William Agnew, Vicky Zeng, Severin Kacianka, Matthew Gombolay

Stereotypes, bias, and discrimination have been extensively documented in Machine Learning (ML) methods such as Computer Vision (CV) [18, 80], Natural Language Processing (NLP) [6], or both, in the case of large image and caption models such as OpenAI CLIP [14].

Bias Detection Gender Bias Detection +4

Multi-UAV Planning for Cooperative Wildfire Coverage and Tracking with Quality-of-Service Guarantees

no code implementations21 Jun 2022 Esmaeil Seraj, Andrew Silva, Matthew Gombolay

Our approach enables UAVs to infer the latent fire propagation dynamics for time-extended coordination in safety-critical conditions.

Strategy Discovery and Mixture in Lifelong Learning from Heterogeneous Demonstration

no code implementations14 Feb 2022 Sravan Jayanthi, Letian Chen, Matthew Gombolay

Learning from Demonstration (LfD) approaches empower end-users to teach robots novel tasks via demonstrations of the desired behaviors, democratizing access to robotics.

Continuous Control

Learning Interpretable, High-Performing Policies for Autonomous Driving

1 code implementation4 Feb 2022 Rohan Paleja, Yaru Niu, Andrew Silva, Chace Ritchie, Sugju Choi, Matthew Gombolay

While the performance of these approaches warrants real-world adoption, these policies lack interpretability, limiting deployability in the safety-critical and legally-regulated domain of autonomous driving (AD).

Autonomous Driving Continuous Control +2

"Good Robot! Now Watch This!": Repurposing Reinforcement Learning for Task-to-Task Transfer

1 code implementation Conference On Robot Learning (CoRL) 2021 Andrew Hundt, Aditya Murali, Priyanka Hubli, Ran Liu, Nakul Gopalan, Matthew Gombolay, Gregory D. Hager

Based upon this insight, we propose See-SPOT-Run (SSR), a new computational approach to robot learning that enables a robot to complete a variety of real robot tasks in novel problem domains without task-specific training.

Few-Shot Learning Meta Reinforcement Learning +3

Guiding Multi-Step Rearrangement Tasks with Natural Language Instructions

2 code implementations Conference On Robot Learning (CoRL) 2021 Elias Stengel-Eskin, Andrew Hundt, Zhuohong He, Aditya Murali, Nakul Gopalan, Matthew Gombolay, Gregory Hager

Our model completes block manipulation tasks with synthetic commands 530 more often than a UNet-based baseline, and learns to localize actions correctly while creating a mapping of symbols to perceptual input that supports compositional reasoning.

Instruction Following

Learning to Follow Language Instructions with Compositional Policies

no code implementations9 Oct 2021 Vanya Cohen, Geraud Nangue Tasse, Nakul Gopalan, Steven James, Matthew Gombolay, Benjamin Rosman

We propose a framework that learns to execute natural language instructions in an environment consisting of goal-reaching tasks that share components of their task descriptions.

Towards Sample-efficient Apprenticeship Learning from Suboptimal Demonstration

no code implementations8 Oct 2021 Letian Chen, Rohan Paleja, Matthew Gombolay

Learning from Demonstration (LfD) seeks to democratize robotics by enabling non-roboticist end-users to teach robots to perform novel tasks by providing demonstrations.

Towards a Comprehensive Understanding and Accurate Evaluation of Societal Biases in Pre-Trained Transformers

no code implementations NAACL 2021 Andrew Silva, Pradyumna Tambwekar, Matthew Gombolay

The ease of access to pre-trained transformers has enabled developers to leverage large-scale language models to build exciting applications for their users.

Natural Language Specification of Reinforcement Learning Policies through Differentiable Decision Trees

1 code implementation18 Jan 2021 Pradyumna Tambwekar, Andrew Silva, Nakul Gopalan, Matthew Gombolay

Human-AI policy specification is a novel procedure we define in which humans can collaboratively warm-start a robot's reinforcement learning policy.

BIG-bench Machine Learning reinforcement-learning +1

A Generalized Robotic Handwriting Learning System based on Dynamic Movement Primitives (DMPs)

1 code implementation7 Dec 2020 Qian Luo, Jing Wu, Matthew Gombolay

Learning from demonstration (LfD) is a powerful learning method to enable a robot to infer how to perform a task given one or more human demonstrations of the desired task.

Robotics

Cross-Loss Influence Functions to Explain Deep Network Representations

1 code implementation3 Dec 2020 Andrew Silva, Rohit Chopra, Matthew Gombolay

As machine learning is increasingly deployed in the real world, it is paramount that we develop the tools necessary to analyze the decision-making of the models we train and deploy to end-users.

Decision Making Language Modelling +1

FireCommander: An Interactive, Probabilistic Multi-agent Environment for Heterogeneous Robot Teams

1 code implementation31 Oct 2020 Esmaeil Seraj, Xiyang Wu, Matthew Gombolay

The FireCommander environment can be useful for research topics spanning a wide range of applications from Reinforcement Learning (RL) and Learning from Demonstration (LfD), to Coordination, Psychology, Human-Robot Interaction (HRI) and Teaming.

Combinatorial Optimization reinforcement-learning +1

Learning from Suboptimal Demonstration via Self-Supervised Reward Regression

1 code implementation17 Oct 2020 Letian Chen, Rohan Paleja, Matthew Gombolay

Learning from Demonstration (LfD) seeks to democratize robotics by enabling non-roboticist end-users to teach robots to perform a task by providing a human demonstration.

regression

Human-Robot Team Coordination with Dynamic and Latent Human Task Proficiencies: Scheduling with Learning Curves

no code implementations3 Jul 2020 Ruisen Liu, Manisha Natarajan, Matthew Gombolay

As robots become ubiquitous in the workforce, it is essential that human-robot collaboration be both intuitive and adaptive.

Scheduling

Coordinated Control of UAVs for Human-Centered Active Sensing of Wildfires

no code implementations14 Jun 2020 Esmaeil Seraj, Matthew Gombolay

Fighting wildfires is a precarious task, imperiling the lives of engaging firefighters and those who reside in the fire's path.

Heterogeneous Learning from Demonstration

no code implementations27 Jan 2020 Rohan Paleja, Matthew Gombolay

This inference requires the robot to be able to detect and classify the heterogeneity of its partners.

Bayesian Inference Starcraft +1

When Your Robot Breaks: Active Learning During Plant Failure

no code implementations17 Dec 2019 Mariah Schrum, Matthew Gombolay

Detecting and adapting to catastrophic failures in robotic systems requires a robot to learn its new dynamics quickly and safely to best accomplish its goals.

Active Learning Model Predictive Control

Learning to Dynamically Coordinate Multi-Robot Teams in Graph Attention Networks

no code implementations4 Dec 2019 Zheyuan Wang, Matthew Gombolay

Increasing interest in integrating advanced robotics within manufacturing has spurred a renewed concentration in developing real-time scheduling solutions to coordinate human-robot collaboration in this environment.

Combinatorial Optimization Graph Attention +3

Interpretable and Personalized Apprenticeship Scheduling: Learning Interpretable Scheduling Policies from Heterogeneous User Demonstrations

1 code implementation NeurIPS 2020 Rohan Paleja, Andrew Silva, Letian Chen, Matthew Gombolay

Resource scheduling and coordination is an NP-hard optimization requiring an efficient allocation of agents to a set of tasks with upper- and lower bound temporal and resource constraints.

Decision Making Scheduling

Safe Coordination of Human-Robot Firefighting Teams

1 code implementation16 Mar 2019 Esmaeil Seraj, Andrew Silva, Matthew Gombolay

Wildfires are destructive and inflict massive, irreversible harm to victims' lives and natural resources.

Inferring Personalized Bayesian Embeddings for Learning from Heterogeneous Demonstration

no code implementations14 Mar 2019 Rohan Paleja, Matthew Gombolay

For assistive robots and virtual agents to achieve ubiquity, machines will need to anticipate the needs of their human counterparts.

Decision Making

Neural-encoding Human Experts' Domain Knowledge to Warm Start Reinforcement Learning

1 code implementation15 Feb 2019 Andrew Silva, Matthew Gombolay

Deep reinforcement learning has been successful in a variety of tasks, such as game playing and robotic manipulation.

Imitation Learning OpenAI Gym +3

Human-Machine Collaborative Optimization via Apprenticeship Scheduling

no code implementations11 May 2018 Matthew Gombolay, Reed Jensen, Jessica Stigile, Toni Golen, Neel Shah, Sung-Hyun Son, Julie Shah

We empirically demonstrate that this approach accurately learns multifaceted heuristics on a synthetic data set incorporating job-shop scheduling and vehicle routing problems, as well as on two real-world data sets consisting of demonstrations of experts solving a weapon-to-target assignment problem and a hospital resource allocation problem.

Decision Making Job Shop Scheduling +1

Cannot find the paper you are looking for? You can Submit a new open access paper.