no code implementations • 30 Oct 2024 • Luisa Mao, Garrett Warnell, Peter Stone, Joydeep Biswas
In autonomous robot navigation, terrain cost assignment is typically performed using a semantics-based paradigm in which terrain is first labeled using a pre-trained semantic classifier and costs are then assigned according to a user-defined mapping between label and cost.
no code implementations • 26 Sep 2023 • Haresh Karnan, Elvin Yang, Daniel Farkash, Garrett Warnell, Joydeep Biswas, Peter Stone
Terrain awareness, i. e., the ability to identify and distinguish different types of terrain, is a critical ability that robots must have to succeed at autonomous off-road navigation.
no code implementations • 18 Sep 2023 • Haresh Karnan, Elvin Yang, Garrett Warnell, Joydeep Biswas, Peter Stone
In this work, we posit that operator preferences for visually novel terrains, which the robot should adhere to, can often be extrapolated from established terrain references within the inertial, proprioceptive, and tactile domain.
no code implementations • 8 Nov 2022 • Eddy Hudson, Ishan Durugkar, Garrett Warnell, Peter Stone
Given a dataset of expert agent interactions with an environment of interest, a viable method to extract an effective agent policy is to estimate the maximum likelihood policy indicated by this data.
no code implementations • 26 Oct 2022 • Caroline Wang, Garrett Warnell, Peter Stone
While combining imitation learning (IL) and reinforcement learning (RL) is a promising way to address poor sample efficiency in autonomous behavior acquisition, methods that do so typically assume that the requisite behavior demonstrations are provided by an expert that behaves optimally with respect to a task reward.
no code implementations • 30 Mar 2022 • Haresh Karnan, Kavan Singh Sikand, Pranav Atreya, Sadegh Rabiee, Xuesu Xiao, Garrett Warnell, Peter Stone, Joydeep Biswas
In this paper, we hypothesize that to enable accurate high-speed off-road navigation using a learned IKD model, in addition to inertial information from the past, one must also anticipate the kinodynamic interactions of the vehicle with the terrain in the future.
no code implementations • 28 Mar 2022 • Haresh Karnan, Anirudh Nair, Xuesu Xiao, Garrett Warnell, Soeren Pirk, Alexander Toshev, Justin Hart, Joydeep Biswas, Peter Stone
Social navigation is the capability of an autonomous agent, such as a robot, to navigate in a 'socially compliant' manner in the presence of other intelligent agents such as humans.
no code implementations • 1 Feb 2022 • Haresh Karnan, Garrett Warnell, Faraz Torabi, Peter Stone
The imitation learning research community has recently made significant progress towards the goal of enabling artificial agents to imitate behaviors from video demonstrations alone.
no code implementations • 18 Sep 2021 • Kavan Singh Sikand, Sadegh Rabiee, Adam Uccello, Xuesu Xiao, Garrett Warnell, Joydeep Biswas
We introduce Visual Representation Learning for Preference-Aware Path Planning (VRL-PAP), an alternative approach that overcomes all three limitations: VRL-PAP leverages unlabeled human demonstrations of navigation to autonomously generate triplets for learning visual representations of terrain that are viewpoint invariant and encode terrain types in a continuous representation space.
no code implementations • 13 Jul 2021 • Ruohan Zhang, Faraz Torabi, Garrett Warnell, Peter Stone
A longstanding goal of artificial intelligence is to create artificial agents capable of learning to perform tasks that require sequential decision making.
no code implementations • 19 May 2021 • Haresh Karnan, Garrett Warnell, Xuesu Xiao, Peter Stone
Is imitation learning for vision based autonomous navigation even possible in such scenarios?
no code implementations • 8 May 2021 • Eddy Hudson, Garrett Warnell, Peter Stone
While Adversarial Imitation Learning (AIL) algorithms have recently led to state-of-the-art results on various imitation learning benchmarks, it is unclear as to what impact various design decisions have on performance.
no code implementations • 15 Apr 2021 • Eddy Hudson, Garrett Warnell, Faraz Torabi, Peter Stone
Learning from demonstrations in the wild (e. g. YouTube videos) is a tantalizing goal in imitation learning.
no code implementations • 31 Mar 2021 • Faraz Torabi, Garrett Warnell, Peter Stone
In imitation learning from observation IfO, a learning agent seeks to imitate a demonstrating agent using only observations of the demonstrated behavior without access to the control signals generated by the demonstrator.
1 code implementation • 29 Sep 2020 • Yunshu Du, Garrett Warnell, Assefaw Gebremedhin, Peter Stone, Matthew E. Taylor
In this work, we introduce Lucid Dreaming for Experience Replay (LiDER), a conceptually new framework that allows replay experiences to be refreshed by leveraging the agent's current policy.
no code implementations • NeurIPS 2020 • Siddharth Desai, Ishan Durugkar, Haresh Karnan, Garrett Warnell, Josiah Hanna, Peter Stone
We examine the problem of transferring a policy learned in a source environment to a target environment with different dynamics, particularly in the case where it is critical to reduce the amount of interaction with the target environment during learning.
no code implementations • 31 Mar 2020 • Xuesu Xiao, Bo Liu, Garrett Warnell, Jonathan Fink, Peter Stone
Existing autonomous robot navigation systems allow robots to move from one point to another in a collision-free manner.
no code implementations • 31 Oct 2019 • Nicholas Waytowich, Sean L. Barton, Vernon Lawhern, Garrett Warnell
While this problem can be addressed through reward shaping, such approaches typically require a human expert with specialized knowledge.
no code implementations • 18 Jun 2019 • Faraz Torabi, Sean Geiger, Garrett Warnell, Peter Stone
We test our algorithm and conduct experiments using an imitation task on a physical robot arm and its simulated version in Gazebo and will show the improvement in learning rate and efficiency.
no code implementations • 18 Jun 2019 • Brahma S. Pavse, Faraz Torabi, Josiah P. Hanna, Garrett Warnell, Peter Stone
Augmenting reinforcement learning with imitation learning is often hailed as a method by which to improve upon learning from scratch.
no code implementations • 30 May 2019 • Faraz Torabi, Garrett Warnell, Peter Stone
Imitation learning is the process by which one agent tries to learn how to perform a certain task using information generated by another, often more-expert agent performing that same task.
no code implementations • 22 May 2019 • Faraz Torabi, Garrett Warnell, Peter Stone
Classically, imitation learning algorithms have been developed for idealized situations, e. g., the demonstrations are often required to be collected in the exact same environment and usually include the demonstrator's actions.
no code implementations • 24 Apr 2019 • Nicholas Waytowich, Sean L. Barton, Vernon Lawhern, Ethan Stump, Garrett Warnell
While deep reinforcement learning techniques have led to agents that are successfully able to learn to perform a number of tasks that had been previously unlearnable, these techniques are still susceptible to the longstanding problem of {\em reward sparsity}.
1 code implementation • 15 Sep 2018 • Prabhat Nagarajan, Garrett Warnell, Peter Stone
One by one, we then allow individual sources of nondeterminism to affect our otherwise deterministic implementation, and measure the impact of each source on the variance in performance.
1 code implementation • 17 Jul 2018 • Faraz Torabi, Garrett Warnell, Peter Stone
Imitation from observation (IfO) is the problem of learning directly from state-only demonstrations without having access to the demonstrator's actions.
6 code implementations • 4 May 2018 • Faraz Torabi, Garrett Warnell, Peter Stone
In this work, we propose a two-phase, autonomous imitation learning technique called behavioral cloning from observation (BCO), that aims to provide improved performance with respect to both of these aspects.
2 code implementations • 28 Sep 2017 • Garrett Warnell, Nicholas Waytowich, Vernon Lawhern, Peter Stone
While recent advances in deep reinforcement learning have allowed autonomous learning agents to succeed at a variety of complex tasks, existing algorithms generally require a lot of training data.
no code implementations • 13 Dec 2016 • Alec Koppel, Garrett Warnell, Ethan Stump, Alejandro Ribeiro
Despite their attractiveness, popular perception is that techniques for nonparametric function approximation do not scale to streaming data due to an intractable growth in the amount of storage they require.
no code implementations • 3 May 2016 • Alec Koppel, Garrett Warnell, Ethan Stump, Alejandro Ribeiro
We consider discriminative dictionary learning in a distributed online setting, where a network of agents aims to learn a common set of dictionary elements of a feature space and model parameters while sequentially receiving observations.
no code implementations • 3 Jan 2014 • Garrett Warnell, Sourabh Bhattacharya, Rama Chellappa, Tamer Basar
We provide two novel adaptive-rate compressive sensing (CS) strategies for sparse, time-varying signals using side information.