no code implementations • 13 Nov 2023 • Arjun Bhardwaj, Jonas Rothfuss, Bhavya Sukhija, Yarden As, Marco Hutter, Stelian Coros, Andreas Krause
We introduce PACOH-RL, a novel model-based Meta-Reinforcement Learning (Meta-RL) algorithm designed to efficiently adapt control policies to changing dynamics.
no code implementations • 5 Oct 2023 • Jin Jin, Chong Zhang, Jonas Frey, Nikita Rudin, Matias Mattamala, Cesar Cadena, Marco Hutter
In this paper, we model perception failures as invisible obstacles and pits, and train a reinforcement learning (RL) based local navigation policy to guide our legged robot.
1 code implementation • 28 Sep 2023 • Gian Erni, Jonas Frey, Takahiro Miki, Matias Mattamala, Marco Hutter
Elevation maps are commonly used to represent the environment of mobile robots and are instrumental for locomotion and navigation tasks.
no code implementations • 25 Sep 2023 • Lukas Schneider, Jonas Frey, Takahiro Miki, Marco Hutter
Instead of relying on a value expectation, we estimate the complete value distribution to account for uncertainty in the robot's interaction with the environment.
Distributional Reinforcement Learning
reinforcement-learning
1 code implementation • 17 Jul 2023 • Jesus Tordesillas, Jonathan P. How, Marco Hutter
This paper presents RAYEN, a framework to impose hard convex constraints on the output or latent variable of a neural network.
no code implementations • 15 May 2023 • Jonas Frey, Matias Mattamala, Nived Chebrolu, Cesar Cadena, Maurice Fallon, Marco Hutter
We demonstrate the advantages of our approach with experiments and ablation studies in challenging environments in forests, parks, and grasslands.
no code implementations • 10 Jan 2023 • Mayank Mittal, Calvin Yu, Qinxi Yu, Jingzhou Liu, Nikita Rudin, David Hoeller, Jia Lin Yuan, Pooria Poorsarvi Tehrani, Ritvik Singh, Yunrong Guo, Hammad Mazhar, Ajay Mandlekar, Buck Babich, Gavriel State, Marco Hutter, Animesh Garg
We present ORBIT, a unified and modular framework for robot learning powered by NVIDIA Isaac Sim.
no code implementations • 26 Oct 2022 • Manthan Patel, Gabriel Waibel, Shehryar Khattak, Marco Hutter
Detecting objects of interest, such as human survivors, safety equipment, and structure access points, is critical to any search-and-rescue operation.
no code implementations • 6 Oct 2022 • Álvaro Belmonte-Baeza, Joonho Lee, Giorgio Valsecchi, Marco Hutter
We use meta reinforcement learning to train a locomotion policy that can quickly adapt to different designs.
no code implementations • 26 Sep 2022 • Nikita Rudin, David Hoeller, Marko Bjelonic, Marco Hutter
It is free to select its path and the locomotion gait.
no code implementations • 2 Aug 2022 • Robin Schmid, Deegan Atha, Frederik Schöller, Sharmita Dey, Seyed Fakoorian, Kyohei Otsu, Barry Ridge, Marko Bjelonic, Lorenz Wellhausen, Marco Hutter, Ali-akbar Agha-mohammadi
Typically, this depends on a semantic understanding which is based on supervised learning from images annotated by a human expert.
no code implementations • 16 Jun 2022 • David Hoeller, Nikita Rudin, Christopher Choy, Animashree Anandkumar, Marco Hutter
We propose a learning-based method to reconstruct the local terrain for locomotion with a mobile robot traversing urban environments.
no code implementations • 23 Mar 2022 • Eric Vollenweider, Marko Bjelonic, Victor Klemm, Nikita Rudin, Joonho Lee, Marco Hutter
Imitation learning approaches such as adversarial motion priors aim to reduce this problem by encouraging a pre-defined motion style.
1 code implementation • 11 Mar 2022 • Julian Nubert, Etienne Walther, Shehryar Khattak, Marco Hutter
LiDAR-based localization and mapping is one of the core components in many modern robotic systems due to the direct integration of range and geometry, allowing for precise motion estimation and generation of high quality maps in real-time.
no code implementations • 1 Dec 2021 • Johannes Pankert, Maria Vittoria Minniti, Lorenz Wellhausen, Marco Hutter
In this work, we propose the novel approach Deep Measurement Update (DMU) as a general update rule for a wide range of systems.
3 code implementations • 24 Sep 2021 • Nikita Rudin, David Hoeller, Philipp Reist, Marco Hutter
In this work, we present and study a training set-up that achieves fast policy generation for real-world robotic tasks by using massive parallelism on a single workstation GPU.
1 code implementation • 15 Sep 2021 • Maximilian Stölzle, Takahiro Miki, Levin Gerdes, Martin Azkarate, Marco Hutter
We first evaluate a supervised learning approach on synthetic data for which we have the full ground-truth available and subsequently move to several real-world datasets.
no code implementations • 8 Apr 2021 • Haoyang Ye, Huaiyang Huang, Marco Hutter, Timothy Sandy, Ming Liu
In this paper, we introduce a method for visual relocalization using the geometric information from a 3D surfel map.
no code implementations • 26 Mar 2021 • Alexander Reske, Jan Carius, Yuntao Ma, Farbod Farshidian, Marco Hutter
We present a learning algorithm for training a single policy that imitates multiple gaits of a walking robot.
1 code implementation • 18 Mar 2021 • Mayank Mittal, David Hoeller, Farbod Farshidian, Marco Hutter, Animesh Garg
A kitchen assistant needs to operate human-scale objects, such as cabinets and ovens, in unmapped environments with dynamic obstacles.
no code implementations • 7 Mar 2021 • David Hoeller, Lorenz Wellhausen, Farbod Farshidian, Marco Hutter
We show that decoupling the pipeline into these components results in a sample efficient policy learning stage that can be fully trained in simulation in just a dozen minutes.
1 code implementation • 10 Nov 2020 • Julian Nubert, Shehryar Khattak, Marco Hutter
Reliable robot pose estimation is a key building block of many robot autonomy pipelines, with LiDAR localization being an active research domain.
Robotics
1 code implementation • 21 Oct 2020 • Joonho Lee, Jemin Hwangbo, Lorenz Wellhausen, Vladlen Koltun, Marco Hutter
The trained controller has taken two generations of quadrupedal ANYmal robots to a variety of natural environments that are beyond the reach of prior published work in legged locomotion.
no code implementations • 4 Dec 2019 • Abel Gawel, Hermann Blum, Johannes Pankert, Koen Krämer, Luca Bartolomei, Selen Ercan, Farbod Farshidian, Margarita Chli, Fabio Gramazio, Roland Siegwart, Marco Hutter, Timothy Sandy
We present a fully-integrated sensing and control system which enables mobile manipulator robots to execute building tasks with millimeter-scale accuracy on building construction sites.
no code implementations • 8 Oct 2019 • Farbod Farshidian, David Hoeller, Marco Hutter
The DMPC actor is a Model Predictive Control (MPC) optimizer with an objective function defined in terms of a value function estimated by the critic.
no code implementations • 18 Sep 2019 • Vassilios Tsounis, Mitja Alge, Joonho Lee, Farbod Farshidian, Marco Hutter
This paper addresses the problem of legged locomotion in non-flat terrain.
1 code implementation • 11 Sep 2019 • Jan Carius, Farbod Farshidian, Marco Hutter
Our loss function, however, corresponds to the minimization of the control Hamiltonian, which derives from the principle of optimality.
2 code implementations • 24 Jan 2019 • Jemin Hwangbo, Joonho Lee, Alexey Dosovitskiy, Dario Bellicoso, Vassilios Tsounis, Vladlen Koltun, Marco Hutter
In the present work, we introduce a method for training a neural network policy in simulation and transferring it to a state-of-the-art legged system, thereby leveraging fast, automated, and cost-effective data generation schemes.
no code implementations • 22 Jan 2019 • Joonho Lee, Jemin Hwangbo, Marco Hutter
We experimentally validate our approach on the quadrupedal robot ANYmal, which is a dog-sized quadrupedal system with 12 degrees of freedom.
no code implementations • 7 Dec 2017 • Michael Neunert, Markus Stäuble, Markus Giftthaler, Carmine D. Bellicoso, Jan Carius, Christian Gehring, Marco Hutter, Jonas Buchli
In this work we present a whole-body Nonlinear Model Predictive Control approach for Rigid Body Systems subject to contacts.
Robotics
1 code implementation • 17 Jul 2017 • Jemin Hwangbo, Inkyu Sa, Roland Siegwart, Marco Hutter
In this paper, we present a method to control a quadrotor with a neural network trained using reinforcement learning techniques.
Robotics
no code implementations • CVPR 2016 • Elena Stumm, Christopher Mei, Simon Lacroix, Juan Nieto, Marco Hutter, Roland Siegwart
A novel method for visual place recognition is introduced and evaluated, demonstrating robustness to perceptual aliasing and observation noise.