Search Results for author: Joydeep Biswas

Found 28 papers, 10 papers with code

Synapse: Learning Preferential Concepts from Visual Demonstrations

no code implementations25 Mar 2024 Sadanand Modak, Noah Patton, Isil Dillig, Joydeep Biswas

This paper addresses the problem of preference learning, which aims to learn user-specific preferences (e. g., "good parking spot", "convenient drop-off location") from visual input.

Autonomous Driving Program Synthesis

Looking Inside Out: Anticipating Driver Intent From Videos

1 code implementation3 Dec 2023 Yung-chi Kung, Arthur Zhang, Junmin Wang, Joydeep Biswas

In this work, we propose a novel method of utilizing in-cabin and external camera data to improve state-of-the-art (SOTA) performance in predicting future driver actions.

STERLING: Self-Supervised Terrain Representation Learning from Unconstrained Robot Experience

no code implementations26 Sep 2023 Haresh Karnan, Elvin Yang, Daniel Farkash, Garrett Warnell, Joydeep Biswas, Peter Stone

Terrain awareness, i. e., the ability to identify and distinguish different types of terrain, is a critical ability that robots must have to succeed at autonomous off-road navigation.

Representation Learning Visual Navigation

ObVi-SLAM: Long-Term Object-Visual SLAM

no code implementations26 Sep 2023 Amanda Adkins, Taijing Chen, Joydeep Biswas

Robots responsible for tasks over long time scales must be able to localize consistently and scalably amid geometric, viewpoint, and appearance changes.

Object Visual Odometry

Wait, That Feels Familiar: Learning to Extrapolate Human Preferences for Preference Aligned Path Planning

no code implementations18 Sep 2023 Haresh Karnan, Elvin Yang, Garrett Warnell, Joydeep Biswas, Peter Stone

In this work, we posit that operator preferences for visually novel terrains, which the robot should adhere to, can often be extrapolated from established terrain references within the inertial, proprioceptive, and tactile domain.

Navigate Robot Navigation +1

Learning Reward Machines through Preference Queries over Sequences

no code implementations18 Aug 2023 Eric Hsiung, Joydeep Biswas, Swarat Chaudhuri

Reward machines have shown great promise at capturing non-Markovian reward functions for learning tasks that involve complex action sequencing.

Decentralized Social Navigation with Non-Cooperative Robots via Bi-Level Optimization

1 code implementation15 Jun 2023 Rohan Chandra, Rahul Menon, Zayne Sprague, Arya Anantula, Joydeep Biswas

This paper presents a fully decentralized approach for realtime non-cooperative multi-robot navigation in social mini-games, such as navigating through a narrow doorway or negotiating right of way at a corridor intersection.

Collision Avoidance Multi-agent Reinforcement Learning +3

LLM+P: Empowering Large Language Models with Optimal Planning Proficiency

1 code implementation22 Apr 2023 Bo Liu, Yuqian Jiang, Xiaohan Zhang, Qiang Liu, Shiqi Zhang, Joydeep Biswas, Peter Stone

LLM+P takes in a natural language description of a planning problem, then returns a correct (or optimal) plan for solving that problem in natural language.

Zero-shot Generalization

System Configuration and Navigation of a Guide Dog Robot: Toward Animal Guide Dog-Level Guiding Work

no code implementations24 Oct 2022 Hochul Hwang, Tim Xia, Ibrahima Keita, Ken Suzuki, Joydeep Biswas, Sunghoon I. Lee, Donghyun Kim

A robot guide dog has compelling advantages over animal guide dogs for its cost-effectiveness, potential for mass production, and low maintenance burden.

SOCIALMAPF: Optimal and Efficient Multi-Agent Path Finding with Strategic Agents for Social Navigation

no code implementations15 Oct 2022 Rohan Chandra, Rahul Maligi, Arya Anantula, Joydeep Biswas

We perform an extensive array of experiments that show that optimal search-based MAPF techniques lead to collisions and increased time-to-goal in SocialMAPF compared to our proposed method using mechanism design.

Motion Planning Multi-Agent Path Finding +1

High-Speed Accurate Robot Control using Learned Forward Kinodynamics and Non-linear Least Squares Optimization

no code implementations16 Jun 2022 Pranav Atreya, Haresh Karnan, Kavan Singh Sikand, Xuesu Xiao, Sadegh Rabiee, Joydeep Biswas

However, the types of control problems these approaches can be applied to are limited only to that of following pre-computed kinodynamically feasible trajectories.

Dense Crowd Flow-Informed Path Planning

no code implementations1 Jun 2022 Emily Pruc, Shlomo Zilberstein, Joydeep Biswas

In the case of pedestrian-unaware mobile robots this desire for safety leads to the freezing robot problem, where a robot confronted with a large dynamic group of obstacles (such as a crowd of pedestrians) would determine all forward navigation unsafe causing the robot to stop in place.

Navigate

VI-IKD: High-Speed Accurate Off-Road Navigation using Learned Visual-Inertial Inverse Kinodynamics

no code implementations30 Mar 2022 Haresh Karnan, Kavan Singh Sikand, Pranav Atreya, Sadegh Rabiee, Xuesu Xiao, Garrett Warnell, Peter Stone, Joydeep Biswas

In this paper, we hypothesize that to enable accurate high-speed off-road navigation using a learned IKD model, in addition to inertial information from the past, one must also anticipate the kinodynamic interactions of the vehicle with the terrain in the future.

Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigation

no code implementations28 Mar 2022 Haresh Karnan, Anirudh Nair, Xuesu Xiao, Garrett Warnell, Soeren Pirk, Alexander Toshev, Justin Hart, Joydeep Biswas, Peter Stone

Social navigation is the capability of an autonomous agent, such as a robot, to navigate in a 'socially compliant' manner in the presence of other intelligent agents such as humans.

Imitation Learning Navigate +1

STEADY: Simultaneous State Estimation and Dynamics Learning from Indirect Observations

1 code implementation2 Mar 2022 Jiayi Wei, Jarrett Holtz, Isil Dillig, Joydeep Biswas

Accurate kinodynamic models play a crucial role in many robotics applications such as off-road navigation and high-speed driving.

Competence-Aware Path Planning via Introspective Perception

no code implementations28 Sep 2021 Sadegh Rabiee, Connor Basich, Kyle Hollins Wray, Shlomo Zilberstein, Joydeep Biswas

First, perception errors are learned in a model-free and location-agnostic setting via introspective perception prior to deployment in novel environments.

Visual Representation Learning for Preference-Aware Path Planning

no code implementations18 Sep 2021 Kavan Singh Sikand, Sadegh Rabiee, Adam Uccello, Xuesu Xiao, Garrett Warnell, Joydeep Biswas

We introduce Visual Representation Learning for Preference-Aware Path Planning (VRL-PAP), an alternative approach that overcomes all three limitations: VRL-PAP leverages unlabeled human demonstrations of navigation to autonomously generate triplets for learning visual representations of terrain that are viewpoint invariant and encode terrain types in a continuous representation space.

Representation Learning Semantic Segmentation

Iterative Program Synthesis for Adaptable Social Navigation

1 code implementation8 Mar 2021 Jarrett Holtz, Simon Andrews, Arjun Guha, Joydeep Biswas

Robot social navigation is influenced by human preferences and environment-specific scenarios such as elevators and doors, thus necessitating end-user adaptability.

Program Synthesis Robotics Programming Languages

Robot Action Selection Learning via Layered Dimension Informed Program Synthesis

1 code implementation10 Aug 2020 Jarrett Holtz, Arjun Guha, Joydeep Biswas

Action selection policies (ASPs), used to compose low-level robot skills into complex high-level tasks are commonly represented as neural networks (NNs) in the state of the art.

Autonomous Driving Program Repair

IV-SLAM: Introspective Vision for Simultaneous Localization and Mapping

no code implementations6 Aug 2020 Sadegh Rabiee, Joydeep Biswas

Existing solutions to visual simultaneous localization and mapping (V-SLAM) assume that errors in feature extraction and matching are independent and identically distributed (i. i. d), but this assumption is known to not be true -- features extracted from low-contrast regions of images exhibit wider error distributions than features from sharp corners.

Simultaneous Localization and Mapping

Learning to Optimize Autonomy in Competence-Aware Systems

no code implementations17 Mar 2020 Connor Basich, Justin Svegliato, Kyle Hollins Wray, Stefan Witwicki, Joydeep Biswas, Shlomo Zilberstein

Interest in semi-autonomous systems (SAS) is growing rapidly as a paradigm to deploy autonomous systems in domains that require occasional reliance on humans.

Autonomous Driving

Localization under Topological Uncertainty for Lane Identification of Autonomous Vehicles

no code implementations4 Mar 2018 Samer B. Nashed, David M. Ilstrup, Joydeep Biswas

We present the Variable Structure Multiple Hidden Markov Model (VSM-HMM) as a framework for localizing in the presence of topological uncertainty, and demonstrate its effectiveness on an AV where lane membership is modeled as a topological localization process.

Autonomous Vehicles Decision Making

Interactive Robot Transition Repair With SMT

2 code implementations5 Feb 2018 Jarrett Holtz, Arjun Guha, Joydeep Biswas

Complex robot behaviors are often structured as state machines, where states encapsulate actions and a transition function switches between states.

Robotics Programming Languages

Human-in-the-Loop SLAM

1 code implementation23 Nov 2017 Samer B. Nashed, Joydeep Biswas

Building large-scale, globally consistent maps is a challenging problem, made more difficult in environments with limited access, sparse features, or when using data collected by novice users.

Human-Computer Interaction Robotics

Cannot find the paper you are looking for? You can Submit a new open access paper.