no code implementations • 6 Sep 2024 • Niklas Funk, Julen Urain, Joao Carvalho, Vignesh Prasad, Georgia Chalvatzaki, Jan Peters
Despite the impressive results of deep generative models in complex manipulation tasks, the absence of a representation that encodes intricate spatial relationships between observations and actions often limits spatial generalization, necessitating large amounts of demonstrations.
no code implementations • 6 Sep 2024 • Felix Herrmann, Sebastian Zach, Jacopo Banfi, Jan Peters, Georgia Chalvatzaki, Davide Tateo
Estimating collision probabilities between robots and environmental obstacles or other moving agents is crucial to ensure safety during path planning.
no code implementations • 8 Aug 2024 • Julen Urain, Ajay Mandlekar, Yilun Du, Mahi Shafiullah, Danfei Xu, Katerina Fragkiadaki, Georgia Chalvatzaki, Jan Peters
In this survey, we aim to provide a unified and comprehensive review of the last year's progress in the use of deep generative models in robotics.
no code implementations • 10 Jul 2024 • Vignesh Prasad, Alap Kshirsagar, Dorothea Koert, Ruth Stock-Homburg, Jan Peters, Georgia Chalvatzaki
In this work, we propose a novel approach for learning a shared latent space representation for HRIs from demonstrations in a Mixture of Experts fashion for reactively generating robot actions from human observations.
no code implementations • 22 Feb 2024 • Yasemin Göksu, Antonio De Almeida Correia, Vignesh Prasad, Alap Kshirsagar, Dorothea Koert, Jan Peters, Georgia Chalvatzaki
Bimanual handovers are crucial for transferring large, deformable or delicate objects.
no code implementations • 2 Dec 2023 • Niklas Funk, Erik Helmut, Georgia Chalvatzaki, Roberto Calandra, Jan Peters
To overcome this shortcoming, we study the idea of replacing the RGB camera with an event-based camera and introduce a new event-based optical tactile sensor called Evetac.
no code implementations • 27 Nov 2023 • Vignesh Prasad, Lea Heitlinger, Dorothea Koert, Ruth Stock-Homburg, Jan Peters, Georgia Chalvatzaki
The generated robot motions are further adapted with Inverse Kinematics to ensure the desired physical proximity with a human, combining the ease of joint space learning and accurate task space reachability.
no code implementations • 3 Nov 2023 • Gabriele Tiboni, Pascal Klink, Jan Peters, Tatiana Tommasi, Carlo D'Eramo, Georgia Chalvatzaki
Varying dynamics parameters in simulation is a popular Domain Randomization (DR) approach for overcoming the reality gap in Reinforcement Learning (RL).
no code implementations • 3 Nov 2023 • Aryaman Reddi, Maximilian Tölle, Jan Peters, Georgia Chalvatzaki, Carlo D'Eramo
To this end, Robust Adversarial Reinforcement Learning (RARL) trains a protagonist against destabilizing forces exercised by an adversary in a competitive zero-sum Markov game, whose optimal solution, i. e., rational strategy, corresponds to a Nash equilibrium.
no code implementations • 30 Sep 2023 • Snehal Jauhri, Sophie Lueth, Georgia Chalvatzaki
In this work, we introduce an active perception pipeline for mobile manipulators to generate motions that are informative toward manipulation tasks, such as grasping in unknown, cluttered scenes.
no code implementations • Robotics: Science & Systems 2024 • Snehal Jauhri, Ishikaa Lunawat, Georgia Chalvatzaki
A significant challenge for real-world robotic manipulation is the effective 6DoF grasping of objects in cluttered scenes from any single viewpoint without the need for additional scene exploration.
no code implementations • 12 May 2023 • Georgia Chalvatzaki, Ali Younes, Daljeet Nandha, An Le, Leonardo F. R. Ribeiro, Iryna Gurevych
Long-horizon task planning is essential for the development of intelligent assistive and service robots.
no code implementations • 4 Dec 2022 • An T. Le, Kay Hansel, Jan Peters, Georgia Chalvatzaki
We present hierarchical policy blending as optimal transport (HiPBOT).
no code implementations • 23 Oct 2022 • Tim Schneider, Boris Belousov, Georgia Chalvatzaki, Diego Romeres, Devesh K. Jha, Jan Peters
Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in recent years.
no code implementations • 22 Oct 2022 • Vignesh Prasad, Dorothea Koert, Ruth Stock-Homburg, Jan Peters, Georgia Chalvatzaki
Modeling interaction dynamics to generate robot trajectories that enable a robot to adapt and react to a human's actions and intentions is critical for efficient and effective collaborative Human-Robot Interactions (HRI).
no code implementations • 14 Oct 2022 • Kay Hansel, Julen Urain, Jan Peters, Georgia Chalvatzaki
To combine the benefits of reactive policies and planning, we propose a hierarchical motion generation method.
1 code implementation • 30 Sep 2022 • Ali Younes, Simone Schaub-Meyer, Georgia Chalvatzaki
Two original information-theoretic losses, computed from local entropy, guide our model to discover consistent keypoint representations; a loss that maximizes the spatial information covered by the keypoints and a loss that optimizes the keypoints' information transportation over time.
no code implementations • 27 Sep 2022 • Puze Liu, Kuo Zhang, Davide Tateo, Snehal Jauhri, Zhiyuan Hu, Jan Peters, Georgia Chalvatzaki
Our proposed approach achieves state-of-the-art performance in simulated high-dimensional and dynamic tasks while avoiding collisions with the environment.
1 code implementation • 8 Sep 2022 • Julen Urain, Niklas Funk, Jan Peters, Georgia Chalvatzaki
In this work, we focus on learning SE(3) diffusion models for 6DoF grasping, giving rise to a novel framework for joint grasp and motion optimization without needing to decouple grasp selection from trajectory generation.
no code implementations • 11 Apr 2022 • Julen Urain, An T. Le, Alexander Lambert, Georgia Chalvatzaki, Byron Boots, Jan Peters
In this paper, we focus on the problem of integrating Energy-based Models (EBM) as guiding priors for motion optimization.
no code implementations • 20 Mar 2022 • Lei Xu, Tianyu Ren, Georgia Chalvatzaki, Jan Peters
Task and Motion Planning (TAMP) provides a hierarchical framework to handle the sequential nature of manipulation tasks by interleaving a symbolic task planner that generates a possible action sequence, with a motion planner that checks the kinematic feasibility in the geometric world, generating robot trajectories if several constraints are satisfied, e. g., a collision-free trajectory from one state to another.
no code implementations • 9 Mar 2022 • Puze Liu, Kuo Zhang, Davide Tateo, Snehal Jauhri, Jan Peters, Georgia Chalvatzaki
Autonomous robots should operate in real-world dynamic environments and collaborate with humans in tight spaces.
no code implementations • 8 Mar 2022 • Snehal Jauhri, Jan Peters, Georgia Chalvatzaki
Finally, we zero-transfer our learned 6D fetching policy with BHyRL to our MM robot TIAGo++.
no code implementations • 8 Mar 2022 • Niklas Funk, Svenja Menzenbach, Georgia Chalvatzaki, Jan Peters
Robot assembly discovery is a challenging problem that lives at the intersection of resource allocation and motion planning.
1 code implementation • 25 Mar 2021 • Andrew S. Morgan, Daljeet Nandha, Georgia Chalvatzaki, Carlo D'Eramo, Aaron M. Dollar, Jan Peters
Substantial advancements to model-based reinforcement learning algorithms have been impeded by the model-bias induced by the collected data, which generally hurts performance.
Model-based Reinforcement Learning Model Predictive Control +3
1 code implementation • 9 Mar 2021 • Tianyu Ren, Georgia Chalvatzaki, Jan Peters
Moreover, we effectively combine this skeleton space with the resultant motion variable spaces into a single extended decision space.
no code implementations • 26 Oct 2020 • Samuele Tosatto, Georgia Chalvatzaki, Jan Peters
Parameterized movement primitives have been extensively used for imitation learning of robotic tasks.
1 code implementation • 9 Jun 2020 • Georgia Chalvatzaki, Nikolaos Gkanatsios, Petros Maragos, Jan Peters
Inherent morphological characteristics in objects may offer a wide range of plausible grasping orientations that obfuscates the visual learning of robotic grasping.
1 code implementation • 21 Apr 2020 • Isidoros Marougkas, Petros Koutras, Nikos Kardaris, Georgios Retsinas, Georgia Chalvatzaki, Petros Maragos
We present a novel multi-attentional convolutional architecture to tackle the problem of real-time RGB-D 6D object pose tracking of single, known objects.
no code implementations • 1 Dec 2018 • Jack Hadfield, Georgia Chalvatzaki, Petros Koutras, Mehdi Khamassi, Costas S. Tzafestas, Petros Maragos
In this work we tackle the problem of child engagement estimation while children freely interact with a robot in their room.
no code implementations • 1 Dec 2018 • Georgia Chalvatzaki, Petros Koutras, Jack Hadfield, Xanthi S. Papageorgiou, Costas S. Tzafestas, Petros Maragos
In this work, we present a novel framework for on-line human gait stability prediction of the elderly users of an intelligent robotic rollator using Long Short Term Memory (LSTM) networks, fusing multimodal RGB-D and Laser Range Finder (LRF) data from non-wearable sensors.