no code implementations • 10 Jul 2023 • Anthony Simeonov, Ankit Goyal, Lucas Manuelli, Lin Yen-Chen, Alina Sarmiento, Alberto Rodriguez, Pulkit Agrawal, Dieter Fox
We propose a system for rearranging objects in a scene to achieve a desired object-scene placing relationship, such as a book inserted in an open slot of a bookshelf.
no code implementations • 13 Dec 2022 • Yann Labbé, Lucas Manuelli, Arsalan Mousavian, Stephen Tyree, Stan Birchfield, Jonathan Tremblay, Justin Carpentier, Mathieu Aubry, Dieter Fox, Josef Sivic
Second, we introduce a novel approach for coarse pose estimation which leverages a network trained to classify whether the pose error between a synthetic rendering and an observed image of the same object can be corrected by the refiner.
1 code implementation • 12 Sep 2022 • Mohit Shridhar, Lucas Manuelli, Dieter Fox
With this formulation, we train a single multi-task Transformer for 18 RLBench tasks (with 249 variations) and 7 real-world tasks (with 18 variations) from just a few demonstrations per task.
Ranked #4 on Robot Manipulation on RLBench
1 code implementation • 24 Sep 2021 • Mohit Shridhar, Lucas Manuelli, Dieter Fox
We even learn one multi-task policy for 10 simulated and 9 real-world tasks that is better or comparable to single-task policies.
1 code implementation • 16 Sep 2019 • Peter Florence, Lucas Manuelli, Russ Tedrake
In this paper we explore using self-supervised correspondence for improving the generalization performance and sample efficiency of visuomotor policy learning.
no code implementations • 15 Mar 2019 • Lucas Manuelli, Wei Gao, Peter Florence, Russ Tedrake
However, representing an object with a parameterized transformation defined on a fixed template cannot capture large intra-category shape variation, and specifying a target pose at a category level can be physically infeasible or fail to accomplish the task -- e. g. knowing the pose and size of a coffee mug relative to some canonical mug is not sufficient to successfully hang it on a rack by its handle.
Robotics
3 code implementations • 22 Jun 2018 • Peter R. Florence, Lucas Manuelli, Russ Tedrake
In this paper we present Dense Object Nets, which build on recent developments in self-supervised dense descriptor learning, as a consistent object representation for visual understanding and manipulation.
1 code implementation • 15 Jul 2017 • Pat Marion, Peter R. Florence, Lucas Manuelli, Russ Tedrake
We use an RGBD camera to collect video of a scene from multiple viewpoints and leverage existing reconstruction techniques to produce a 3D dense reconstruction.