1 code implementation • 1 Apr 2024 • Yijia Weng, Bowen Wen, Jonathan Tremblay, Valts Blukis, Dieter Fox, Leonidas Guibas, Stan Birchfield
We address the problem of building digital twins of unknown articulated objects from two RGBD scans of the object at different articulation states.
1 code implementation • 13 Dec 2023 • Bowen Wen, Wei Yang, Jan Kautz, Stan Birchfield
We present FoundationPose, a unified foundation model for 6D object pose estimation and tracking, supporting both model-based and model-free setups.
no code implementations • 26 Oct 2023 • Ajay Mandlekar, Soroush Nasiriany, Bowen Wen, Iretiayo Akinola, Yashraj Narang, Linxi Fan, Yuke Zhu, Dieter Fox
Imitation learning from a large set of human demonstrations has proved to be an effective paradigm for building capable robot agents.
no code implementations • 30 Sep 2023 • Jonathan Tremblay, Bowen Wen, Valts Blukis, Balakumar Sundaralingam, Stephen Tyree, Stan Birchfield
We introduce Diff-DOPE, a 6-DoF pose refiner that takes as input an image, a 3D textured model of an object, and an initial pose of the object.
no code implementations • 2 Aug 2023 • Andrew Guo, Bowen Wen, Jianhe Yuan, Jonathan Tremblay, Stephen Tyree, Jeffrey Smith, Stan Birchfield
We outline the usefulness of our dataset for 6-DoF category-level pose+scale estimation and related tasks.
no code implementations • CVPR 2023 • Taeyeop Lee, Jonathan Tremblay, Valts Blukis, Bowen Wen, Byeong-Uk Lee, Inkyu Shin, Stan Birchfield, In So Kweon, Kuk-Jin Yoon
Unlike previous unsupervised domain adaptation methods for category-level object pose estimation, our approach processes the test data in a sequential, online manner, and it does not require access to the source domain at runtime.
1 code implementation • CVPR 2023 • Bowen Wen, Jonathan Tremblay, Valts Blukis, Stephen Tyree, Thomas Muller, Alex Evans, Dieter Fox, Jan Kautz, Stan Birchfield
We present a near real-time method for 6-DoF tracking of an unknown object from a monocular RGBD video sequence, while simultaneously performing neural 3D reconstruction of the object.
no code implementations • 21 Oct 2022 • Zhenggang Tang, Balakumar Sundaralingam, Jonathan Tremblay, Bowen Wen, Ye Yuan, Stephen Tyree, Charles Loop, Alexander Schwing, Stan Birchfield
We present a system for collision-free control of a robot manipulator that uses only RGB views of the world.
no code implementations • 21 Oct 2022 • Valts Blukis, Taeyeop Lee, Jonathan Tremblay, Bowen Wen, In So Kweon, Kuk-Jin Yoon, Dieter Fox, Stan Birchfield
At test-time, we build the representation from a single RGB input image observing the scene from only one viewpoint.
1 code implementation • 18 Oct 2022 • Yunzhi Lin, Thomas Müller, Jonathan Tremblay, Bowen Wen, Stephen Tyree, Alex Evans, Patricio A. Vela, Stan Birchfield
We present a parallelized optimization method based on fast Neural Radiance Fields (NeRF) for estimating 6-DoF pose of a camera with respect to an object or scene.
no code implementations • 8 Mar 2022 • Junchi Liang, Bowen Wen, Kostas Bekris, Abdeslam Boularias
This work aims to learn how to perform complex robot manipulation tasks that are composed of several, consecutively executed low-level sub-tasks, given as input a few visual demonstrations of the tasks performed by a person.
2 code implementations • 30 Jan 2022 • Bowen Wen, Wenzhao Lian, Kostas Bekris, Stefan Schaal
The canonical object representation is learned solely in simulation and then used to parse a category-level, task trajectory from a single demonstration video.
1 code implementation • 19 Sep 2021 • Bowen Wen, Wenzhao Lian, Kostas Bekris, Stefan Schaal
This work proposes a framework to learn task-relevant grasping for industrial objects without the need of time-consuming real-world data collection or manual annotation.
1 code implementation • 1 Aug 2021 • Bowen Wen, Kostas Bekris
Most prior efforts, however, often assume that the target object's CAD model, at least at a category-level, is available for offline training or during online template matching.
Ranked #1 on 6D Pose Estimation using RGBD on REAL275 (mAP 3DIou@25 metric)
1 code implementation • 26 Jun 2021 • Andrew S. Morgan, Bowen Wen, Junchi Liang, Abdeslam Boularias, Aaron M. Dollar, Kostas Bekris
Highly constrained manipulation tasks continue to be challenging for autonomous robots as they require high levels of precision, typically less than 1mm, which is often incompatible with what can be achieved by traditional perception systems.
1 code implementation • 29 May 2021 • Bowen Wen, Chaitanya Mitash, Kostas Bekris
This work presents se(3)-TrackNet, a data-driven optimization approach for long term, 6D pose tracking.
1 code implementation • 27 Jul 2020 • Bowen Wen, Chaitanya Mitash, Baozhang Ren, Kostas E. Bekris
Tracking the 6D pose of objects in video sequences is important for robot manipulation.
Ranked #5 on 6D Pose Estimation on YCB-Video
no code implementations • 28 Jun 2020 • Chaitanya Mitash, Rahul Shome, Bowen Wen, Abdeslam Boularias, Kostas Bekris
The effectiveness of the proposed approach is demonstrated by developing a robotic system that picks a previously unseen object from a table-top and places it in a constrained space.
Robotics
1 code implementation • L4DC 2020 • Avishai Sintov, Andrew Kimmel, Bowen Wen, Abdeslam Boularias, Kostas Bekris
Precise in-hand manipulation is an important skill for a robot to perform tasks in human environments.
Model-based Reinforcement Learning Reinforcement Learning (RL)
1 code implementation • 7 Mar 2020 • Bowen Wen, Chaitanya Mitash, Sruthi Soorian, Andrew Kimmel, Avishai Sintov, Kostas E. Bekris
The hand's point cloud is pruned and robust global registration is performed to generate object pose hypotheses, which are clustered.
6D Pose Estimation using RGB 6D Pose Estimation using RGBD +4
no code implementations • 11 Oct 2019 • Chaitanya Mitash, Bowen Wen, Kostas Bekris, Abdeslam Boularias
To evaluate this method, a dataset of densely packed objects with challenging setups for state-of-the-art approaches is collected.
1 code implementation • journal 2018 • Bowen Wen, Sukru Yaren Gelbal, Bilin Aksun Guvenc, Levent Guvenc
The Ohio State University has designated a small segment in an underserved area of campus as an initial autonomous vehicle (AV) pilot test route for the deployment of low speed autonomous shuttles.