Search Results for author: Glen Berseth

Found 34 papers, 9 papers with code

Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control

no code implementations30 Jan 2024 Zhongyu Li, Xue Bin Peng, Pieter Abbeel, Sergey Levine, Glen Berseth, Koushil Sreenath

Going beyond focusing on a single locomotion skill, we develop a general control solution that can be used for a range of dynamic bipedal skills, from periodic walking and running to aperiodic jumping and standing.

reinforcement-learning Reinforcement Learning (RL)

Closing the Gap between TD Learning and Supervised Learning -- A Generalisation Point of View

1 code implementation20 Jan 2024 Raj Ghugare, Matthieu Geist, Glen Berseth, Benjamin Eysenbach

Based on this analysis, we construct new datasets to explicitly test for this property, revealing that SL-based methods lack this stitching property and hence fail to perform combinatorial generalization.

Data Augmentation Reinforcement Learning (RL)

Improving Intrinsic Exploration by Creating Stationary Objectives

1 code implementation27 Oct 2023 Roger Creus Castanyer, Joshua Romoff, Glen Berseth

Several exploration objectives like count-based bonuses, pseudo-counts, and state-entropy maximization are non-stationary and hence are difficult to optimize for the agent.

Reasoning with Latent Diffusion in Offline Reinforcement Learning

1 code implementation12 Sep 2023 Siddarth Venkatraman, Shivesh Khaitan, Ravi Tej Akella, John Dolan, Jeff Schneider, Glen Berseth

However, a key challenge in offline RL lies in effectively stitching portions of suboptimal trajectories from the static dataset while avoiding extrapolation errors arising due to a lack of support in the dataset.

D4RL Offline RL +3

Bootstrapping Adaptive Human-Machine Interfaces with Offline Reinforcement Learning

no code implementations7 Sep 2023 Jensen Gao, Siddharth Reddy, Glen Berseth, Anca D. Dragan, Sergey Levine

We further evaluate on a simulated Sawyer pushing task with eye gaze control, and the Lunar Lander game with simulated user commands, and find that our method improves over baseline interfaces in these domains as well.

Brain Computer Interface Decision Making +1

Robust and Versatile Bipedal Jumping Control through Reinforcement Learning

no code implementations19 Feb 2023 Zhongyu Li, Xue Bin Peng, Pieter Abbeel, Sergey Levine, Glen Berseth, Koushil Sreenath

This work aims to push the limits of agility for bipedal robots by enabling a torque-controlled bipedal robot to perform robust and versatile dynamic jumps in the real world.

reinforcement-learning Reinforcement Learning (RL)

Hierarchical Reinforcement Learning for Precise Soccer Shooting Skills using a Quadrupedal Robot

no code implementations1 Aug 2022 Yandong Ji, Zhongyu Li, Yinan Sun, Xue Bin Peng, Sergey Levine, Glen Berseth, Koushil Sreenath

Developing algorithms to enable a legged robot to shoot a soccer ball to a given target is a challenging problem that combines robot motion control and planning into one task.

Friction Hierarchical Reinforcement Learning +3

AnyMorph: Learning Transferable Polices By Inferring Agent Morphology

no code implementations17 Jun 2022 Brandon Trabucco, Mariano Phielipp, Glen Berseth

Ours is the first reinforcement learning algorithm that can train a policy to generalize to new agent morphologies without requiring a description of the agent's morphology in advance.

reinforcement-learning Reinforcement Learning (RL) +1

ASHA: Assistive Teleoperation via Human-in-the-Loop Reinforcement Learning

no code implementations5 Feb 2022 Sean Chen, Jensen Gao, Siddharth Reddy, Glen Berseth, Anca D. Dragan, Sergey Levine

Building assistive interfaces for controlling robots through arbitrary, high-dimensional, noisy inputs (e. g., webcam images of eye gaze) can be challenging, especially when it involves inferring the user's desired action in the absence of a natural 'default' interface.

reinforcement-learning Reinforcement Learning (RL)

CoMPS: Continual Meta Policy Search

no code implementations ICLR 2022 Glen Berseth, Zhiwei Zhang, Grace Zhang, Chelsea Finn, Sergey Levine

Beyond simply transferring past experience to new tasks, our goal is to devise continual reinforcement learning algorithms that learn to learn, using their experience on previous tasks to learn new tasks more quickly.

Continual Learning Continuous Control +5

Information is Power: Intrinsic Control via Information Capture

no code implementations NeurIPS 2021 Nicholas Rhinehart, Jenny Wang, Glen Berseth, John D. Co-Reyes, Danijar Hafner, Chelsea Finn, Sergey Levine

We study this question in dynamic partially-observed environments, and argue that a compact and general learning objective is to minimize the entropy of the agent's state visitation estimated using a latent state-space model.

Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation

no code implementations28 Jul 2021 Charles Sun, Jędrzej Orbik, Coline Devin, Brian Yang, Abhishek Gupta, Glen Berseth, Sergey Levine

Our aim is to devise a robotic reinforcement learning system for learning navigation and manipulation together, in an autonomous way without human intervention, enabling continual learning under realistic assumptions.

Continual Learning Navigate +2

Intrinsic Control of Variational Beliefs in Dynamic Partially-Observed Visual Environments

no code implementations ICML Workshop URL 2021 Nicholas Rhinehart, Jenny Wang, Glen Berseth, John D Co-Reyes, Danijar Hafner, Chelsea Finn, Sergey Levine

We study this question in dynamic partially-observed environments, and argue that a compact and general learning objective is to minimize the entropy of the agent's state visitation estimated using a latent state-space model.

DisCo RL: Distribution-Conditioned Reinforcement Learning for General-Purpose Policies

no code implementations23 Apr 2021 Soroush Nasiriany, Vitchyr H. Pong, Ashvin Nair, Alexander Khazatsky, Glen Berseth, Sergey Levine

Contextual policies provide this capability in principle, but the representation of the context determines the degree of generalization and expressivity.

reinforcement-learning Reinforcement Learning (RL) +1

Accelerating Online Reinforcement Learning via Model-Based Meta-Learning

no code implementations ICLR Workshop Learning_to_Learn 2021 John D Co-Reyes, Sarah Feng, Glen Berseth, Jie Qui, Sergey Levine

Current reinforcement learning algorithms struggle to quickly adapt to new situations without large amounts of experience and usually without large amounts of optimization over that experience.

Meta-Learning reinforcement-learning +1

Visual Imitation with Reinforcement Learning using Recurrent Siamese Networks

no code implementations1 Jan 2021 Glen Berseth, Florian Golemo, Christopher Pal

It would be desirable for a reinforcement learning (RL) based agent to learn behaviour by merely watching a demonstration.

One-Shot Learning reinforcement-learning +1

Ecological Reinforcement Learning

no code implementations22 Jun 2020 John D. Co-Reyes, Suvansh Sanjeev, Glen Berseth, Abhishek Gupta, Sergey Levine

Much of the current work on reinforcement learning studies episodic settings, where the agent is reset between trials to an initial state distribution, often with well-shaped reward functions.

reinforcement-learning Reinforcement Learning (RL)

Morphology-Agnostic Visual Robotic Control

no code implementations31 Dec 2019 Brian Yang, Dinesh Jayaraman, Glen Berseth, Alexei Efros, Sergey Levine

Existing approaches for visuomotor robotic control typically require characterizing the robot in advance by calibrating the camera or performing system identification.

Inter-Level Cooperation in Hierarchical Reinforcement Learning

1 code implementation5 Dec 2019 Abdul Rahman Kreidieh, Glen Berseth, Brandon Trabucco, Samyak Parajuli, Sergey Levine, Alexandre M. Bayen

This allows us to draw on connections between communication and cooperation in multi-agent RL, and demonstrate the benefits of increased cooperation between sub-policies on the training performance of the overall policy.

Hierarchical Reinforcement Learning reinforcement-learning +1

Contextual Imagined Goals for Self-Supervised Robotic Learning

1 code implementation23 Oct 2019 Ashvin Nair, Shikhar Bahl, Alexander Khazatsky, Vitchyr Pong, Glen Berseth, Sergey Levine

When the robot's environment and available objects vary, as they do in most open-world settings, the robot must propose to itself only those goals that it can accomplish in its present setting with the objects that are at hand.

reinforcement-learning Reinforcement Learning (RL)

Towards Learning to Imitate from a Single Video Demonstration

no code implementations22 Jan 2019 Glen Berseth, Florian Golemo, Christopher Pal

We approach this challenge using contrastive training to learn a reward function comparing an agent's behaviour with a single demonstration.

Imitation Learning One-Shot Learning +1

Visual Imitation Learning with Recurrent Siamese Networks

no code implementations27 Sep 2018 Glen Berseth, Christopher J. Pal

In this paper we propose an approach using only visual information to learn a distance metric between agent behaviour and a given video demonstration.

Imitation Learning

Terrain RL Simulator

1 code implementation17 Apr 2018 Glen Berseth, Xue Bin Peng, Michiel Van de Panne

We provide $89$ challenging simulation environments that range in difficulty.

Feedback Control For Cassie With Deep Reinforcement Learning

3 code implementations15 Mar 2018 Zhaoming Xie, Glen Berseth, Patrick Clary, Jonathan Hurst, Michiel Van de Panne

By formulating a feedback control problem as finding the optimal policy for a Markov Decision Process, we are able to learn robust walking controllers that imitate a reference motion with DRL.

Robotics

Progressive Reinforcement Learning with Distillation for Multi-Skilled Motion Control

no code implementations ICLR 2018 Glen Berseth, Cheng Xie, Paul Cernek, Michiel Van de Panne

Deep reinforcement learning has demonstrated increasing capabilities for continuous control problems, including agents that can move with skill and agility through their environment.

Continuous Control reinforcement-learning +2

Model-Based Action Exploration for Learning Dynamic Motion Skills

no code implementations11 Jan 2018 Glen Berseth, Michiel Van de Panne

Deep reinforcement learning has achieved great strides in solving challenging motion control tasks.

Cannot find the paper you are looking for? You can Submit a new open access paper.