Search Results for author: Devesh K. Jha

Found 28 papers, 1 papers with code

Symbolic Analysis-based Reduced Order Markov Modeling of Time Series Data

no code implementations26 Sep 2017 Devesh K. Jha, Nurali Virani, Jan Reimann, Abhishek Srivastav, Asok Ray

In the second example, the data set is taken from NASA's data repository for prognostics of bearings on rotating shafts.

Bayesian Inference Clustering +2

Trajectory Optimization for Unknown Constrained Systems using Reinforcement Learning

no code implementations13 Mar 2019 Kei Ota, Devesh K. Jha, Tomoaki Oiki, Mamoru Miura, Takashi Nammoto, Daniel Nikovski, Toshisada Mariyama

Our experiments show that our RL agent trained with a reference path outperformed a model-free PID controller of the type commonly used on many robotic platforms for trajectory tracking.

Motion Planning reinforcement-learning +1

Game Theoretic Optimization via Gradient-based Nikaido-Isoda Function

no code implementations15 May 2019 Arvind U. Raghunathan, Anoop Cherian, Devesh K. Jha

To this end, we introduce the Gradient-based Nikaido-Isoda (GNI) function which serves: (i) as a merit function, vanishing only at the first-order stationary points of each player's optimization problem, and (ii) provides error bounds to a stationary Nash point.

Safe Approximate Dynamic Programming Via Kernelized Lipschitz Estimation

no code implementations3 Jul 2019 Ankush Chakrabarty, Devesh K. Jha, Gregery T. Buzzard, Yebin Wang, Kyriakos Vamvoudakis

We develop a method for obtaining safe initial policies for reinforcement learning via approximate dynamic programming (ADP) techniques for uncertain systems evolving with discrete-time dynamics.

reinforcement-learning Reinforcement Learning (RL)

Multi-label Prediction in Time Series Data using Deep Neural Networks

no code implementations27 Jan 2020 Wenyu Zhang, Devesh K. Jha, Emil Laftchiev, Daniel Nikovski

In the most general setting of these types of problems, one or more samples of data across multiple time series can be assigned several concurrent fault labels from a finite, known set and the task is to predict the possibility of fault occurrence over a desired time horizon.

Event Detection General Classification +4

Model-Based Reinforcement Learning for Physical Systems Without Velocity and Acceleration Measurements

no code implementations25 Feb 2020 Alberto Dalla Libera, Diego Romeres, Devesh K. Jha, Bill Yerazunis, Daniel Nikovski

In this paper, we propose a derivative-free model learning framework for Reinforcement Learning (RL) algorithms based on Gaussian Process Regression (GPR).

GPR Model-based Reinforcement Learning +2

Can Increasing Input Dimensionality Improve Deep Reinforcement Learning?

1 code implementation ICML 2020 Kei Ota, Tomoaki Oiki, Devesh K. Jha, Toshisada Mariyama, Daniel Nikovski

We believe that stronger feature propagation together with larger networks (and thus larger search space) allows RL agents to learn more complex functions of states and thus improves the sample efficiency.

Decision Making reinforcement-learning +1

Efficient Exploration in Constrained Environments with Goal-Oriented Reference Path

no code implementations3 Mar 2020 Kei Ota, Yoko SASAKI, Devesh K. Jha, Yusuke Yoshiyasu, Asako Kanezaki

Specifically, we train a deep convolutional network that can predict collision-free paths based on a map of the environment-- this is then used by a reinforcement learning algorithm to learn to closely follow the path.

Efficient Exploration Navigate +2

CAZSL: Zero-Shot Regression for Pushing Models by Generalizing Through Context

no code implementations26 Mar 2020 Wenyu Zhang, Skyler Seto, Devesh K. Jha

The purpose of these agents is to quickly adapt and/or generalize their notion of physics of interaction in the real world based on certain features about the interacting objects that provide different contexts to the predictive models.

Meta-Learning regression +1

Understanding Multi-Modal Perception Using Behavioral Cloning for Peg-In-a-Hole Insertion Tasks

no code implementations22 Jul 2020 Yifang Liu, Diego Romeres, Devesh K. Jha, Daniel Nikovski

One of the main challenges in peg-in-a-hole (PiH) insertion tasks is in handling the uncertainty in the location of the target hole.

Deep Reactive Planning in Dynamic Environments

no code implementations31 Oct 2020 Kei Ota, Devesh K. Jha, Tadashi Onishi, Asako Kanezaki, Yusuke Yoshiyasu, Yoko SASAKI, Toshisada Mariyama, Daniel Nikovski

The main novelty of the proposed approach is that it allows a robot to learn an end-to-end policy which can adapt to changes in the environment during execution.

Training Larger Networks for Deep Reinforcement Learning

no code implementations16 Feb 2021 Kei Ota, Devesh K. Jha, Asako Kanezaki

Previous work has shown that this is mostly due to instability during training of deep RL agents when using larger networks.

reinforcement-learning Reinforcement Learning (RL) +1

Markov Modeling of Time-Series Data using Symbolic Analysis

no code implementations20 Mar 2021 Devesh K. Jha

On the other hand, memory estimation of the symbolic sequence helps to extract the predictive patterns in the discretized data.

Time Series Time Series Analysis

PYROBOCOP : Python-based Robotic Control & Optimization Package for Manipulation and Collision Avoidance

no code implementations6 Jun 2021 Arvind U. Raghunathan, Devesh K. Jha, Diego Romeres

PYROBOCOP is a lightweight Python-based package for control and optimization of robotic systems described by nonlinear Differential Algebraic Equations (DAEs).

Collision Avoidance

Imitation and Supervised Learning of Compliance for Robotic Assembly

no code implementations20 Nov 2021 Devesh K. Jha, Diego Romeres, William Yerazunis, Daniel Nikovski

This can be used to learn a suitable representation of the skill that can be generalized to novel positions of one of the parts involved in the assembly, for example the hole in a peg-in-hole (PiH) insertion task.

Industrial Robots Position

Chance-Constrained Optimization in Contact-Rich Systems for Robust Manipulation

no code implementations5 Mar 2022 Yuki Shirai, Devesh K. Jha, Arvind Raghunathan, Diego Romeres

In our formulation, we explicitly consider joint chance constraints for complementarity as well as states to capture the stochastic evolution of dynamics.

Constrained Dynamic Movement Primitives for Safe Learning of Motor Skills

no code implementations28 Sep 2022 Seiji Shaw, Devesh K. Jha, Arvind Raghunathan, Radu Corcodel, Diego Romeres, George Konidaris, Daniel Nikovski

In this paper, we present constrained dynamic movement primitives (CDMP) which can allow for constraint satisfaction in the robot workspace.

Active Exploration for Robotic Manipulation

no code implementations23 Oct 2022 Tim Schneider, Boris Belousov, Georgia Chalvatzaki, Diego Romeres, Devesh K. Jha, Jan Peters

Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in recent years.

Model-based Reinforcement Learning Model Predictive Control

Generalizable Human-Robot Collaborative Assembly Using Imitation Learning and Force Control

no code implementations2 Dec 2022 Devesh K. Jha, Siddarth Jain, Diego Romeres, William Yerazunis, Daniel Nikovski

In this paper, we present a system for human-robot collaborative assembly using learning from demonstration and pose estimation, so that the robot can adapt to the uncertainty caused by the operation of humans.

Imitation Learning Pose Estimation

Tactile-Filter: Interactive Tactile Perception for Part Mating

no code implementations10 Mar 2023 Kei Ota, Devesh K. Jha, Hsiao-Yu Tung, Joshua B. Tenenbaum

We evaluate our method on several part-mating tasks with novel objects using a robot equipped with a vision-based tactile sensor.

Robust Pivoting Manipulation using Contact Implicit Bilevel Optimization

no code implementations15 Mar 2023 Yuki Shirai, Devesh K. Jha, Arvind U. Raghunathan

This requirement makes manipulation extremely challenging as a robot has to reason about complex frictional interactions with uncertainty in physical properties of the object and the environment.

Bilevel Optimization Friction

A Virtual Reality Teleoperation Interface for Industrial Robot Manipulators

no code implementations18 May 2023 Eric Rosen, Devesh K. Jha

We address the problem of teleoperating an industrial robot manipulator via a commercially available Virtual Reality (VR) interface.

Tactile Estimation of Extrinsic Contact Patch for Stable Placement

no code implementations25 Sep 2023 Kei Ota, Devesh K. Jha, Krishna Murthy Jatavallabhula, Asako Kanezaki, Joshua B. Tenenbaum

In particular, we estimate the contact patch between a grasped object and its environment using force and tactile observations to estimate the stability of the object during a contact formation.

Object

Multi-level Reasoning for Robotic Assembly: From Sequence Inference to Contact Selection

no code implementations17 Dec 2023 Xinghao Zhu, Devesh K. Jha, Diego Romeres, Lingfeng Sun, Masayoshi Tomizuka, Anoop Cherian

Automating the assembly of objects from their parts is a complex problem with innumerable applications in manufacturing, maintenance, and recycling.

Motion Planning valid

Cannot find the paper you are looking for? You can Submit a new open access paper.