1 code implementation • 6 Nov 2023 • Shiyang Lu, Haonan Chang, Eric Pu Jing, Abdeslam Boularias, Kostas Bekris
This work presents OVIR-3D, a straightforward yet effective method for open-vocabulary 3D object instance retrieval without using any 3D data for training.
Ranked #6 on 3D Open-Vocabulary Instance Segmentation on Replica
no code implementations • 27 Oct 2023 • Kristin J. Dana, Clinton Andrews, Kostas Bekris, Jacob Feldman, Matthew Stone, Pernille Hemmer, Aaron Mazzeo, Hal Salzman, Jingang Yi
Emerging applications of robotics, and concerns about their impact, require the research community to put human-centric objectives front-and-center.
1 code implementation • 27 Sep 2023 • Haonan Chang, Kowndinya Boyalakuntla, Shiyang Lu, Siwei Cai, Eric Jing, Shreesh Keskar, Shijie Geng, Adeeb Abbas, Lifeng Zhou, Kostas Bekris, Abdeslam Boularias
We present an Open-Vocabulary 3D Scene Graph (OVSG), a formal framework for grounding a variety of entities, such as object instances, agents, and regions, with free-form text-based queries.
no code implementations • 23 Sep 2023 • Shuai Li, Azarakhsh Keipour, Kevin Jamieson, Nicolas Hudson, Sicong Zhao, Charles Swan, Kostas Bekris
Automating warehouse operations can reduce logistics overhead costs, ultimately driving down the final price for consumers, increasing the speed of delivery, and enhancing the resiliency to market fluctuations.
no code implementations • 17 May 2023 • Shuai Li, Azarakhsh Keipour, Kevin Jamieson, Nicolas Hudson, Charles Swan, Kostas Bekris
This paper demonstrates a large-scale package manipulation from unstructured piles in Amazon Robotics' Robot Induction (Robin) fleet, which utilizes a pick success predictor trained on real production data.
no code implementations • 9 Apr 2023 • Shiyang Lu, Yunfu Deng, Abdeslam Boularias, Kostas Bekris
This work proposes a self-supervised learning system for segmenting rigid objects in RGB images.
no code implementations • 13 Sep 2022 • Kun Wang, William R. Johnson III, Shiyang Lu, Xiaonan Huang, Joran Booth, Rebecca Kramer-Bottiglio, Mridul Aanjaneya, Kostas Bekris
This strategy is based on a differentiable physics engine that can be trained given limited data from a real robot.
no code implementations • 29 May 2022 • Shiyang Lu, William R. Johnson III, Kun Wang, Xiaonan Huang, Joran Booth, Rebecca Kramer-Bottiglio, Kostas Bekris
To ensure that the pose estimates of rigid elements are physically feasible, i. e., they are not resulting in collisions between rods or with the environment, physical constraints are introduced during the optimization.
2 code implementations • 19 Mar 2022 • Rui Wang, Kai Gao, Jingjin Yu, Kostas Bekris
Object rearrangement is important for many applications but remains challenging, especially in confined spaces, such as shelves, where objects cannot be accessed from above and they block reachability to each other.
no code implementations • 8 Mar 2022 • Junchi Liang, Bowen Wen, Kostas Bekris, Abdeslam Boularias
This work aims to learn how to perform complex robot manipulation tasks that are composed of several, consecutively executed low-level sub-tasks, given as input a few visual demonstrations of the tasks performed by a person.
no code implementations • 28 Feb 2022 • Kun Wang, Mridul Aanjaneya, Kostas Bekris
A model of NASA's icosahedron SUPERballBot on MuJoCo is used as the ground truth system to collect training data.
2 code implementations • 30 Jan 2022 • Bowen Wen, Wenzhao Lian, Kostas Bekris, Stefan Schaal
The canonical object representation is learned solely in simulation and then used to parse a category-level, task trajectory from a single demonstration video.
1 code implementation • 19 Sep 2021 • Bowen Wen, Wenzhao Lian, Kostas Bekris, Stefan Schaal
This work proposes a framework to learn task-relevant grasping for industrial objects without the need of time-consuming real-world data collection or manual annotation.
1 code implementation • 1 Aug 2021 • Bowen Wen, Kostas Bekris
Most prior efforts, however, often assume that the target object's CAD model, at least at a category-level, is available for offline training or during online template matching.
Ranked #1 on 6D Pose Estimation using RGBD on REAL275 (mAP 3DIou@25 metric)
1 code implementation • 26 Jun 2021 • Andrew S. Morgan, Bowen Wen, Junchi Liang, Abdeslam Boularias, Aaron M. Dollar, Kostas Bekris
Highly constrained manipulation tasks continue to be challenging for autonomous robots as they require high levels of precision, typically less than 1mm, which is often incompatible with what can be achieved by traditional perception systems.
1 code implementation • 29 May 2021 • Bowen Wen, Chaitanya Mitash, Kostas Bekris
This work presents se(3)-TrackNet, a data-driven optimization approach for long term, 6D pose tracking.
no code implementations • 7 Dec 2020 • Sebastian Höfer, Kostas Bekris, Ankur Handa, Juan Camilo Gamboa, Florian Golemo, Melissa Mozifian, Chris Atkeson, Dieter Fox, Ken Goldberg, John Leonard, C. Karen Liu, Jan Peters, Shuran Song, Peter Welinder, Martha White
This report presents the debates, posters, and discussions of the Sim2Real workshop held in conjunction with the 2020 edition of the "Robotics: Science and System" conference.
no code implementations • 10 Nov 2020 • Kun Wang, Mridul Aanjaneya, Kostas Bekris
The results indicate that only 0. 25\% of ground truth data are needed to train a policy that works on the ground truth system when the differentiable engine is used for training against training the policy directly on the ground truth system.
no code implementations • 9 Nov 2020 • Kun Wang, Mridul Aanjaneya, Kostas Bekris
We propose a novel differentiable physics engine for system identification of complex spring-rod assemblies.
no code implementations • 28 Jun 2020 • Chaitanya Mitash, Rahul Shome, Bowen Wen, Abdeslam Boularias, Kostas Bekris
The effectiveness of the proposed approach is demonstrated by developing a robotic system that picks a previously unseen object from a table-top and places it in a constrained space.
Robotics
1 code implementation • L4DC 2020 • Avishai Sintov, Andrew Kimmel, Bowen Wen, Abdeslam Boularias, Kostas Bekris
Precise in-hand manipulation is an important skill for a robot to perform tasks in human environments.
Model-based Reinforcement Learning Reinforcement Learning (RL)
no code implementations • L4DC 2020 • Kun Wang, Mridul Aanjaneya, Kostas Bekris
We propose a novel differentiable physics engine for system identification of complex spring-rod assemblies.
1 code implementation • 13 Dec 2019 • Malihe Alikhani, Baber Khalid, Rahul Shome, Chaitanya Mitash, Kostas Bekris, Matthew Stone
This work proposes a set of interpretive principles for how a robotic arm can use pointing actions to communicate task information to people by extending existing models from the related literature.
no code implementations • 11 Oct 2019 • Chaitanya Mitash, Bowen Wen, Kostas Bekris, Abdeslam Boularias
To evaluate this method, a dataset of densely packed objects with challenging setups for state-of-the-art approaches is collected.
no code implementations • 9 Oct 2018 • Tomas Hodan, Rigas Kouskouridas, Tae-Kyun Kim, Federico Tombari, Kostas Bekris, Bertram Drost, Thibault Groueix, Krzysztof Walas, Vincent Lepetit, Ales Leonardis, Carsten Steger, Frank Michel, Caner Sahin, Carsten Rother, Jiri Matas
The workshop featured four invited talks, oral and poster presentations of accepted workshop papers, and an introduction of the BOP benchmark for 6D object pose estimation.
no code implementations • 25 Jun 2018 • Chaitanya Mitash, Abdeslam Boularias, Kostas Bekris
This work proposes an autonomous process for pose estimation that spans from data generation to scene-level reasoning and self-learning.
no code implementations • 16 May 2018 • Chaitanya Mitash, Abdeslam Boularias, Kostas Bekris
The pointsets are then matched to congruent sets on the 3D object model to generate pose estimates.