no code implementations • 8 Aug 2024 • Xiaolin Fang, Leslie Pack Kaelbling, Tomás Lozano-Pérez
To deal with uncertainty in robot perception, we propose a method for generating a hypothesis distribution of object segmentation.
no code implementations • 8 Jun 2024 • Aidan Curtis, Nishanth Kumar, Jing Cao, Tomás Lozano-Pérez, Leslie Pack Kaelbling
Recent developments in pretrained large language models (LLMs) applied to robotics have demonstrated their capacity for sequencing a set of discrete skills to achieve open-ended goals in simple robotic tasks.
no code implementations • 15 Mar 2024 • Aidan Curtis, George Matheos, Nishad Gothoskar, Vikash Mansinghka, Joshua Tenenbaum, Tomás Lozano-Pérez, Leslie Pack Kaelbling
We propose a strategy for TAMP with Uncertainty and Risk Awareness (TAMPURA) that is capable of efficiently solving long-horizon planning problems with initial-state and action outcome uncertainty, including problems that require information gathering and avoiding undesirable and irreversible outcomes.
no code implementations • 22 Feb 2024 • Nishanth Kumar, Tom Silver, Willie McClinton, Linfeng Zhao, Stephen Proulx, Tomás Lozano-Pérez, Leslie Pack Kaelbling, Jennifer Barry
We consider a setting where a robot is initially equipped with (1) a library of parameterized skills, (2) an AI planner for sequencing together the skills given a goal, and (3) a very general prior distribution for selecting skill parameters.
1 code implementation • NeurIPS 2023 • Jiayuan Mao, Tomás Lozano-Pérez, Joshua B. Tenenbaum, Leslie Pack Kaelbling
Goal-conditioned policies are generally understood to be "feed-forward" circuits, in the form of neural networks that map from the current state and the goal specification to the next action to take.
no code implementations • 6 Nov 2023 • Jiayuan Mao, Joshua B. Tenenbaum, Tomás Lozano-Pérez, Leslie Pack Kaelbling
Humans demonstrate an impressive ability to acquire and generalize manipulation "tricks."
no code implementations • 2 Sep 2023 • Zhutian Yang, Jiayuan Mao, Yilun Du, Jiajun Wu, Joshua B. Tenenbaum, Tomás Lozano-Pérez, Leslie Pack Kaelbling
This paper introduces an approach for learning to solve continuous constraint satisfaction problems (CCSP) in robotic reasoning and planning.
no code implementations • 13 Jul 2023 • Jorge Mendez-Mendez, Leslie Pack Kaelbling, Tomás Lozano-Pérez
A robot deployed in a home over long stretches of time faces a true lifelong learning problem.
no code implementations • 22 Jun 2023 • Xiaolin Fang, Caelan Reed Garrett, Clemens Eppner, Tomás Lozano-Pérez, Leslie Pack Kaelbling, Dieter Fox
Task and Motion Planning (TAMP) approaches are effective at planning long-horizon autonomous robot manipulation.
no code implementations • 9 Mar 2023 • Jiayuan Mao, Tomás Lozano-Pérez, Joshua B. Tenenbaum, Leslie Pack Kaelbling
This paper studies a model learning and online planning approach towards building flexible and general robots.
no code implementations • 9 Mar 2023 • Zhezheng Luo, Jiayuan Mao, Jiajun Wu, Tomás Lozano-Pérez, Joshua B. Tenenbaum, Leslie Pack Kaelbling
We present a framework for learning useful subgoals that support efficient long-term planning to achieve novel goals.
no code implementations • 3 Nov 2022 • Zhutian Yang, Caelan Reed Garrett, Tomás Lozano-Pérez, Leslie Kaelbling, Dieter Fox
The core of our algorithm is PIGINet, a novel Transformer-based learning method that takes in a task plan, the goal, and the initial state, and predicts the probability of finding motion trajectories associated with the task plan.
1 code implementation • 16 Aug 2022 • Nishanth Kumar, Willie McClinton, Rohan Chitnis, Tom Silver, Tomás Lozano-Pérez, Leslie Pack Kaelbling
An effective approach to solving long-horizon tasks in robotics domains with continuous state and action spaces is bilevel planning, wherein a high-level search over an abstraction of an environment is used to guide low-level decision-making.
no code implementations • 9 Mar 2022 • Beomjoon Kim, Luke Shimanuki, Leslie Pack Kaelbling, Tomás Lozano-Pérez
The first is an algorithm for learning a rank function that guides the discrete task level search, and the second is an algorithm for learning a sampler that guides the continuous motionlevel search.
no code implementations • 9 Aug 2021 • Aidan Curtis, Xiaolin Fang, Leslie Pack Kaelbling, Tomás Lozano-Pérez, Caelan Reed Garrett
We present a strategy for designing and building very general robot manipulation systems involving the integration of a general-purpose task-and-motion planner with engineered and learned perception modules that estimate properties and affordances of unknown objects.
no code implementations • 1 Jul 2021 • Michael Noseworthy, Caris Moses, Isaiah Brand, Sebastian Castro, Leslie Kaelbling, Tomás Lozano-Pérez, Nicholas Roy
Long horizon sequential manipulation tasks are effectively addressed hierarchically: at a high level of abstraction the planner searches over abstract action sequences, and when a plan is found, lower level motion plans are generated.
no code implementations • 7 Jan 2021 • Rachel Holladay, Tomás Lozano-Pérez, Alberto Rodriguez
The robot must choose a sequence of discrete actions, or strategy, such as whether to pick up an object, and the continuous parameters of each of those actions, such as how to grasp the object.
Robotics
no code implementations • 2 Oct 2020 • Caelan Reed Garrett, Rohan Chitnis, Rachel Holladay, Beomjoon Kim, Tom Silver, Leslie Pack Kaelbling, Tomás Lozano-Pérez
The problem of planning for a robot that operates in environments containing a large number of objects, taking actions to move itself through the world as well as to change the state of the objects, is known as task and motion planning (TAMP).
1 code implementation • 8 Jun 2020 • Zi Wang, Caelan Reed Garrett, Leslie Pack Kaelbling, Tomás Lozano-Pérez
We use, and develop novel improvements on, state-of-the-art methods for active learning and sampling.
no code implementations • 6 Jun 2020 • Caris Moses, Michael Noseworthy, Leslie Pack Kaelbling, Tomás Lozano-Pérez, Nicholas Roy
Given a novel object, the objective is to maximize reward with few interactions.
no code implementations • 6 Feb 2020 • Caelan Reed Garrett, Yijiang Huang, Tomás Lozano-Pérez, Caitlin Tobin Mueller
There is increasing demand for automated systems that can fabricate 3D structures.
1 code implementation • 11 Nov 2019 • Caelan Reed Garrett, Chris Paxton, Tomás Lozano-Pérez, Leslie Pack Kaelbling, Dieter Fox
To solve multi-step manipulation tasks in the real world, an autonomous robot must take actions to observe its environment and react to unexpected observations.
no code implementations • 30 Sep 2019 • Rohan Chitnis, Tomás Lozano-Pérez
We address the problem of approximate model minimization for MDPs in which the state is partitioned into endogenous and (much larger) exogenous components.
1 code implementation • 20 Sep 2018 • Rohan Chitnis, Leslie Pack Kaelbling, Tomás Lozano-Pérez
Multi-object manipulation problems in continuous state and action spaces can be solved by planners that search over sampled values for the continuous parameters of operators.
1 code implementation • 26 Jun 2018 • Ferran Alet, Tomás Lozano-Pérez, Leslie P. Kaelbling
Many prediction problems, such as those that arise in the context of robotics, have a simplifying underlying structure that, if known, could accelerate learning.
no code implementations • 21 May 2018 • Rohan Chitnis, Leslie Pack Kaelbling, Tomás Lozano-Pérez
We consider such a setting in which the agent can, while acting, transmit declarative information to the human that helps them understand aspects of this unseen environment.
2 code implementations • 2 Mar 2018 • Zi Wang, Caelan Reed Garrett, Leslie Pack Kaelbling, Tomás Lozano-Pérez
Solving long-horizon problems in complex domains requires flexible generative planning that can combine primitive abilities in novel combinations to solve problems as they arise in the world.
no code implementations • 28 Feb 2018 • Rohan Chitnis, Leslie Pack Kaelbling, Tomás Lozano-Pérez
In partially observed environments, it can be useful for a human to provide the robot with declarative information that represents probabilistic relational constraints on properties of objects in the world, augmenting the robot's sensory observations.
4 code implementations • 23 Feb 2018 • Caelan Reed Garrett, Tomás Lozano-Pérez, Leslie Pack Kaelbling
We extend PDDL to support a generic, declarative specification for these procedures that treats their implementation as black boxes.
4 code implementations • 1 Jan 2017 • Caelan Reed Garrett, Tomás Lozano-Pérez, Leslie Pack Kaelbling
We introduce STRIPStream: an extension of the STRIPS language which can model these domains by supporting the specification of blackbox generators to handle complex constraints.
no code implementations • 26 Jul 2016 • Zi Wang, Stefanie Jegelka, Leslie Pack Kaelbling, Tomás Lozano-Pérez
We introduce a framework for model learning and planning in stochastic domains with continuous state and action spaces and non-Gaussian transition models.
no code implementations • NeurIPS 2015 • Kenji Kawaguchi, Leslie Pack Kaelbling, Tomás Lozano-Pérez
This paper presents a Bayesian optimization method with exponential convergence without the need of auxiliary optimization and without the delta-cover sampling.
no code implementations • 2 Dec 2015 • Lawson L. S. Wong, Thanard Kurutach, Leslie Pack Kaelbling, Tomás Lozano-Pérez
We refer to this attribute-based representation as a world model, and consider how to acquire it via noisy perception and maintain it over time, as objects are added, changed, and removed in the world.