Search Results for author: Garrett Warnell

Found 29 papers, 5 papers with code

STERLING: Self-Supervised Terrain Representation Learning from Unconstrained Robot Experience

no code implementations26 Sep 2023 Haresh Karnan, Elvin Yang, Daniel Farkash, Garrett Warnell, Joydeep Biswas, Peter Stone

Terrain awareness, i. e., the ability to identify and distinguish different types of terrain, is a critical ability that robots must have to succeed at autonomous off-road navigation.

Representation Learning Visual Navigation

Wait, That Feels Familiar: Learning to Extrapolate Human Preferences for Preference Aligned Path Planning

no code implementations18 Sep 2023 Haresh Karnan, Elvin Yang, Garrett Warnell, Joydeep Biswas, Peter Stone

In this work, we posit that operator preferences for visually novel terrains, which the robot should adhere to, can often be extrapolated from established terrain references within the inertial, proprioceptive, and tactile domain.

Navigate Robot Navigation +1

ABC: Adversarial Behavioral Cloning for Offline Mode-Seeking Imitation Learning

no code implementations8 Nov 2022 Eddy Hudson, Ishan Durugkar, Garrett Warnell, Peter Stone

Given a dataset of expert agent interactions with an environment of interest, a viable method to extract an effective agent policy is to estimate the maximum likelihood policy indicated by this data.

Generative Adversarial Network Imitation Learning

D-Shape: Demonstration-Shaped Reinforcement Learning via Goal Conditioning

no code implementations26 Oct 2022 Caroline Wang, Garrett Warnell, Peter Stone

While combining imitation learning (IL) and reinforcement learning (RL) is a promising way to address poor sample efficiency in autonomous behavior acquisition, methods that do so typically assume that the requisite behavior demonstrations are provided by an expert that behaves optimally with respect to a task reward.

Imitation Learning reinforcement-learning +1

VI-IKD: High-Speed Accurate Off-Road Navigation using Learned Visual-Inertial Inverse Kinodynamics

no code implementations30 Mar 2022 Haresh Karnan, Kavan Singh Sikand, Pranav Atreya, Sadegh Rabiee, Xuesu Xiao, Garrett Warnell, Peter Stone, Joydeep Biswas

In this paper, we hypothesize that to enable accurate high-speed off-road navigation using a learned IKD model, in addition to inertial information from the past, one must also anticipate the kinodynamic interactions of the vehicle with the terrain in the future.

Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigation

no code implementations28 Mar 2022 Haresh Karnan, Anirudh Nair, Xuesu Xiao, Garrett Warnell, Soeren Pirk, Alexander Toshev, Justin Hart, Joydeep Biswas, Peter Stone

Social navigation is the capability of an autonomous agent, such as a robot, to navigate in a 'socially compliant' manner in the presence of other intelligent agents such as humans.

Imitation Learning Navigate +1

Adversarial Imitation Learning from Video using a State Observer

no code implementations1 Feb 2022 Haresh Karnan, Garrett Warnell, Faraz Torabi, Peter Stone

The imitation learning research community has recently made significant progress towards the goal of enabling artificial agents to imitate behaviors from video demonstrations alone.

Continuous Control Imitation Learning

Visual Representation Learning for Preference-Aware Path Planning

no code implementations18 Sep 2021 Kavan Singh Sikand, Sadegh Rabiee, Adam Uccello, Xuesu Xiao, Garrett Warnell, Joydeep Biswas

We introduce Visual Representation Learning for Preference-Aware Path Planning (VRL-PAP), an alternative approach that overcomes all three limitations: VRL-PAP leverages unlabeled human demonstrations of navigation to autonomously generate triplets for learning visual representations of terrain that are viewpoint invariant and encode terrain types in a continuous representation space.

Representation Learning Semantic Segmentation

Recent Advances in Leveraging Human Guidance for Sequential Decision-Making Tasks

no code implementations13 Jul 2021 Ruohan Zhang, Faraz Torabi, Garrett Warnell, Peter Stone

A longstanding goal of artificial intelligence is to create artificial agents capable of learning to perform tasks that require sequential decision making.

Decision Making

RAIL: A modular framework for Reinforcement-learning-based Adversarial Imitation Learning

no code implementations8 May 2021 Eddy Hudson, Garrett Warnell, Peter Stone

While Adversarial Imitation Learning (AIL) algorithms have recently led to state-of-the-art results on various imitation learning benchmarks, it is unclear as to what impact various design decisions have on performance.

Imitation Learning OpenAI Gym +2

Skeletal Feature Compensation for Imitation Learning with Embodiment Mismatch

no code implementations15 Apr 2021 Eddy Hudson, Garrett Warnell, Faraz Torabi, Peter Stone

Learning from demonstrations in the wild (e. g. YouTube videos) is a tantalizing goal in imitation learning.

Imitation Learning

DEALIO: Data-Efficient Adversarial Learning for Imitation from Observation

no code implementations31 Mar 2021 Faraz Torabi, Garrett Warnell, Peter Stone

In imitation learning from observation IfO, a learning agent seeks to imitate a demonstrating agent using only observations of the demonstrated behavior without access to the control signals generated by the demonstrator.

Imitation Learning Model-based Reinforcement Learning +2

Lucid Dreaming for Experience Replay: Refreshing Past States with the Current Policy

1 code implementation29 Sep 2020 Yunshu Du, Garrett Warnell, Assefaw Gebremedhin, Peter Stone, Matthew E. Taylor

In this work, we introduce Lucid Dreaming for Experience Replay (LiDER), a conceptually new framework that allows replay experiences to be refreshed by leveraging the agent's current policy.

Atari Games Reinforcement Learning (RL)

An Imitation from Observation Approach to Transfer Learning with Dynamics Mismatch

no code implementations NeurIPS 2020 Siddharth Desai, Ishan Durugkar, Haresh Karnan, Garrett Warnell, Josiah Hanna, Peter Stone

We examine the problem of transferring a policy learned in a source environment to a target environment with different dynamics, particularly in the case where it is critical to reduce the amount of interaction with the target environment during learning.

Transfer Learning

APPLD: Adaptive Planner Parameter Learning from Demonstration

no code implementations31 Mar 2020 Xuesu Xiao, Bo Liu, Garrett Warnell, Jonathan Fink, Peter Stone

Existing autonomous robot navigation systems allow robots to move from one point to another in a collision-free manner.

Robot Navigation

A Narration-based Reward Shaping Approach using Grounded Natural Language Commands

no code implementations31 Oct 2019 Nicholas Waytowich, Sean L. Barton, Vernon Lawhern, Garrett Warnell

While this problem can be addressed through reward shaping, such approaches typically require a human expert with specialized knowledge.

Starcraft Starcraft II

Sample-efficient Adversarial Imitation Learning from Observation

no code implementations18 Jun 2019 Faraz Torabi, Sean Geiger, Garrett Warnell, Peter Stone

We test our algorithm and conduct experiments using an imitation task on a physical robot arm and its simulated version in Gazebo and will show the improvement in learning rate and efficiency.

Imitation Learning Reinforcement Learning (RL)

Recent Advances in Imitation Learning from Observation

no code implementations30 May 2019 Faraz Torabi, Garrett Warnell, Peter Stone

Imitation learning is the process by which one agent tries to learn how to perform a certain task using information generated by another, often more-expert agent performing that same task.

Imitation Learning

Imitation Learning from Video by Leveraging Proprioception

no code implementations22 May 2019 Faraz Torabi, Garrett Warnell, Peter Stone

Classically, imitation learning algorithms have been developed for idealized situations, e. g., the demonstrations are often required to be collected in the exact same environment and usually include the demonstrator's actions.

Imitation Learning

Grounding Natural Language Commands to StarCraft II Game States for Narration-Guided Reinforcement Learning

no code implementations24 Apr 2019 Nicholas Waytowich, Sean L. Barton, Vernon Lawhern, Ethan Stump, Garrett Warnell

While deep reinforcement learning techniques have led to agents that are successfully able to learn to perform a number of tasks that had been previously unlearnable, these techniques are still susceptible to the longstanding problem of {\em reward sparsity}.

Reinforcement Learning (RL) Starcraft +1

Deterministic Implementations for Reproducibility in Deep Reinforcement Learning

1 code implementation15 Sep 2018 Prabhat Nagarajan, Garrett Warnell, Peter Stone

One by one, we then allow individual sources of nondeterminism to affect our otherwise deterministic implementation, and measure the impact of each source on the variance in performance.

Q-Learning reinforcement-learning +1

Generative Adversarial Imitation from Observation

1 code implementation17 Jul 2018 Faraz Torabi, Garrett Warnell, Peter Stone

Imitation from observation (IfO) is the problem of learning directly from state-only demonstrations without having access to the demonstrator's actions.

Imitation Learning

Behavioral Cloning from Observation

5 code implementations4 May 2018 Faraz Torabi, Garrett Warnell, Peter Stone

In this work, we propose a two-phase, autonomous imitation learning technique called behavioral cloning from observation (BCO), that aims to provide improved performance with respect to both of these aspects.

Imitation Learning

Deep TAMER: Interactive Agent Shaping in High-Dimensional State Spaces

2 code implementations28 Sep 2017 Garrett Warnell, Nicholas Waytowich, Vernon Lawhern, Peter Stone

While recent advances in deep reinforcement learning have allowed autonomous learning agents to succeed at a variety of complex tasks, existing algorithms generally require a lot of training data.

reinforcement-learning Reinforcement Learning (RL) +1

Parsimonious Online Learning with Kernels via Sparse Projections in Function Space

no code implementations13 Dec 2016 Alec Koppel, Garrett Warnell, Ethan Stump, Alejandro Ribeiro

Despite their attractiveness, popular perception is that techniques for nonparametric function approximation do not scale to streaming data due to an intractable growth in the amount of storage they require.

General Classification

Decentralized Dynamic Discriminative Dictionary Learning

no code implementations3 May 2016 Alec Koppel, Garrett Warnell, Ethan Stump, Alejandro Ribeiro

We consider discriminative dictionary learning in a distributed online setting, where a network of agents aims to learn a common set of dictionary elements of a feature space and model parameters while sequentially receiving observations.

Dictionary Learning

Adaptive-Rate Compressive Sensing Using Side Information

no code implementations3 Jan 2014 Garrett Warnell, Sourabh Bhattacharya, Rama Chellappa, Tamer Basar

We provide two novel adaptive-rate compressive sensing (CS) strategies for sparse, time-varying signals using side information.

Compressive Sensing

Cannot find the paper you are looking for? You can Submit a new open access paper.