Search Results for author: Abdeslam Boularias

Found 32 papers, 11 papers with code

OVIR-3D: Open-Vocabulary 3D Instance Retrieval Without Training on 3D Data

1 code implementation6 Nov 2023 Shiyang Lu, Haonan Chang, Eric Pu Jing, Abdeslam Boularias, Kostas Bekris

This work presents OVIR-3D, a straightforward yet effective method for open-vocabulary 3D object instance retrieval without using any 3D data for training.

3D Open-Vocabulary Instance Segmentation Region Proposal +2

Context-Aware Entity Grounding with Open-Vocabulary 3D Scene Graphs

1 code implementation27 Sep 2023 Haonan Chang, Kowndinya Boyalakuntla, Shiyang Lu, Siwei Cai, Eric Jing, Shreesh Keskar, Shijie Geng, Adeeb Abbas, Lifeng Zhou, Kostas Bekris, Abdeslam Boularias

We present an Open-Vocabulary 3D Scene Graph (OVSG), a formal framework for grounding a variety of entities, such as object instances, agents, and regions, with free-form text-based queries.

Navigate Object +2

Optical Flow boosts Unsupervised Localization and Segmentation

1 code implementation25 Jul 2023 Xinyu Zhang, Abdeslam Boularias

Our fine-tuning procedure outperforms state-of-the-art techniques for unsupervised semantic segmentation through linear probing, without the use of any labeled data.

Object Optical Flow Estimation +3

Mono-STAR: Mono-camera Scene-level Tracking and Reconstruction

1 code implementation30 Jan 2023 Haonan Chang, Dhruv Metha Ramesh, Shijie Geng, Yuqiu Gan, Abdeslam Boularias

We present Mono-STAR, the first real-time 3D reconstruction system that simultaneously supports semantic fusion, fast motion tracking, non-rigid object deformation, and topological change under a unified framework.

3D Reconstruction Optical Flow Estimation

Scene-level Tracking and Reconstruction without Object Priors

1 code implementation7 Oct 2022 Haonan Chang, Abdeslam Boularias

We present the first real-time system capable of tracking and reconstructing, individually, every visible object in a given scene, without any form of prior on the rigidness of the objects, texture existence, or object category.

Object

Learning Sensorimotor Primitives of Sequential Manipulation Tasks from Visual Demonstrations

no code implementations8 Mar 2022 Junchi Liang, Bowen Wen, Kostas Bekris, Abdeslam Boularias

This work aims to learn how to perform complex robot manipulation tasks that are composed of several, consecutively executed low-level sub-tasks, given as input a few visual demonstrations of the tasks performed by a person.

Imitation Learning Object +1

Vision-driven Compliant Manipulation for Reliable, High-Precision Assembly Tasks

1 code implementation26 Jun 2021 Andrew S. Morgan, Bowen Wen, Junchi Liang, Abdeslam Boularias, Aaron M. Dollar, Kostas Bekris

Highly constrained manipulation tasks continue to be challenging for autonomous robots as they require high levels of precision, typically less than 1mm, which is often incompatible with what can be achieved by traditional perception systems.

Motion Planning Object +2

A Self-supervised Learning System for Object Detection in Videos Using Random Walks on Graphs

1 code implementation10 Nov 2020 Juntao Tan, Changkyu Song, Abdeslam Boularias

The triplet examples are finally used to train a siamese neural network that projects the generic visual features into a low-dimensional manifold.

Clustering object-detection +2

DIPN: Deep Interaction Prediction Network with Application to Clutter Removal

1 code implementation9 Nov 2020 Baichuan Huang, Shuai D. Han, Abdeslam Boularias, Jingjin Yu

The high accuracy of DIPN allows direct integration with a grasp network, yielding a robotic manipulation system capable of executing challenging clutter removal tasks while being trained in a fully self-supervised manner.

Friction

Learning Transition Models with Time-delayed Causal Relations

no code implementations4 Aug 2020 Junchi Liang, Abdeslam Boularias

This paper introduces an algorithm for discovering implicit and delayed causal relations between events observed by a robot at arbitrary times, with the objective of improving data-efficiency and interpretability of model-based reinforcement learning (RL) techniques.

Model-based Reinforcement Learning reinforcement-learning +1

Task-driven Perception and Manipulation for Constrained Placement of Unknown Objects

no code implementations28 Jun 2020 Chaitanya Mitash, Rahul Shome, Bowen Wen, Abdeslam Boularias, Kostas Bekris

The effectiveness of the proposed approach is demonstrated by developing a robotic system that picks a previously unseen object from a table-top and places it in a constrained space.

Robotics

Learning to Transfer Dynamic Models of Underactuated Soft Robotic Hands

no code implementations21 May 2020 Liam Schramm, Avishai Sintov, Abdeslam Boularias

We find that a major cause of these problems is that models trained on small amounts of data can have chaotic or divergent behavior in some regions.

Transfer Learning

Identifying Mechanical Models through Differentiable Simulations

no code implementations L4DC 2020 Changkyu Song, Abdeslam Boularias

This paper proposes a new method for manipulating unknown objects through a sequence of non-prehensile actions that displace an object from its initial configuration to a given goal configuration on a flat surface.

Friction

Learning to Slide Unknown Objects with Differentiable Physics Simulations

no code implementations11 May 2020 Changkyu Song, Abdeslam Boularias

We propose a new technique for pushing an unknown object from an initial configuration to a goal configuration with stability constraints.

Friction

Scene-level Pose Estimation for Multiple Instances of Densely Packed Objects

no code implementations11 Oct 2019 Chaitanya Mitash, Bowen Wen, Kostas Bekris, Abdeslam Boularias

To evaluate this method, a dataset of densely packed objects with challenging setups for state-of-the-art approaches is collected.

6D Pose Estimation

Inferring 3D Shapes of Unknown Rigid Objects in Clutter through Inverse Physics Reasoning

no code implementations13 Mar 2019 Changkyu Song, Abdeslam Boularias

We present a probabilistic approach for building, on the fly, 3-D models of unknown objects while being manipulated by a robot.

Physics-based Scene-level Reasoning for Object Pose Estimation in Clutter

no code implementations25 Jun 2018 Chaitanya Mitash, Abdeslam Boularias, Kostas Bekris

This work proposes an autonomous process for pose estimation that spans from data generation to scene-level reasoning and self-learning.

object-detection Object Detection +3

Learning Object Localization and 6D Pose Estimation from Simulation and Weakly Labeled Real Images

no code implementations18 Jun 2018 Jean-Philippe Mercier, Chaitanya Mitash, Philippe Giguère, Abdeslam Boularias

We then show that the performance of the detector can be substantially improved by using a small set of weakly annotated real images, where a human provides only a list of objects present in each image without indicating the location of the objects.

6D Pose Estimation 6D Pose Estimation using RGB +4

Efficient Model Identification for Tensegrity Locomotion

no code implementations12 Apr 2018 Shaojun Zhu, David Surovik, Kostas E. Bekris, Abdeslam Boularias

This paper aims to identify in a practical manner unknown physical parameters, such as mechanical models of actuated robot links, which are critical in dynamical robotic tasks.

Bayesian Optimization

Improving 6D Pose Estimation of Objects in Clutter via Physics-aware Monte Carlo Tree Search

no code implementations24 Oct 2017 Chaitanya Mitash, Abdeslam Boularias, Kostas E. Bekris

Experimental results indicate that this process is able to quickly identify in cluttered scenes physically-consistent object poses that are significantly closer to ground truth compared to poses found by point cloud registration methods.

6D Pose Estimation 6D Pose Estimation using RGB +4

Fast Model Identification via Physics Engines for Data-Efficient Policy Search

no code implementations24 Oct 2017 Shaojun Zhu, Andrew Kimmel, Kostas E. Bekris, Abdeslam Boularias

This paper presents a method for identifying mechanical parameters of robots or objects, such as their mass and friction coefficients.

Bayesian Optimization Friction +1

Information-theoretic Model Identification and Policy Search using Physics Engines with Application to Robotic Manipulation

no code implementations22 Mar 2017 Shaojun Zhu, Andrew Kimmel, Abdeslam Boularias

We consider the problem of a robot learning the mechanical properties of objects through physical interaction with the object, and introduce a practical, data-efficient approach for identifying the motion models of these objects.

Bayesian Optimization Friction +1

A Self-supervised Learning System for Object Detection using Physics Simulation and Multi-view Pose Estimation

1 code implementation9 Mar 2017 Chaitanya Mitash, Kostas E. Bekris, Abdeslam Boularias

The models are placed in physically realistic poses with respect to their environment to generate a labeled synthetic dataset.

Object object-detection +4

Gradient Weights help Nonparametric Regressors

no code implementations NeurIPS 2012 Samory Kpotufe, Abdeslam Boularias

In regression problems over $\real^d$, the unknown function $f$ often varies more in some coordinates than in others.

regression

Bootstrapping Apprenticeship Learning

no code implementations NeurIPS 2010 Abdeslam Boularias, Brahim Chaib-Draa

We consider the problem of apprenticeship learning where the examples, demonstrated by an expert, cover only a small part of a large state space.

Car Racing

Cannot find the paper you are looking for? You can Submit a new open access paper.