Search Results for author: Daniel Nikovski

Found 23 papers, 2 papers with code

Learning Control from Raw Position Measurements

no code implementations30 Jan 2023 Fabio Amadio, Alberto Dalla Libera, Daniel Nikovski, Ruggero Carli, Diego Romeres

We propose a Model-Based Reinforcement Learning (MBRL) algorithm named VF-MC-PILCO, specifically designed for application to mechanical systems where velocities cannot be directly measured.

Model-based Reinforcement Learning Position

Generalizable Human-Robot Collaborative Assembly Using Imitation Learning and Force Control

no code implementations2 Dec 2022 Devesh K. Jha, Siddarth Jain, Diego Romeres, William Yerazunis, Daniel Nikovski

In this paper, we present a system for human-robot collaborative assembly using learning from demonstration and pose estimation, so that the robot can adapt to the uncertainty caused by the operation of humans.

Imitation Learning Pose Estimation

Constrained Dynamic Movement Primitives for Safe Learning of Motor Skills

no code implementations28 Sep 2022 Seiji Shaw, Devesh K. Jha, Arvind Raghunathan, Radu Corcodel, Diego Romeres, George Konidaris, Daniel Nikovski

In this paper, we present constrained dynamic movement primitives (CDMP) which can allow for constraint satisfaction in the robot workspace.

Transformer Networks for Predictive Group Elevator Control

no code implementations15 Aug 2022 Jing Zhang, Athanasios Tsiligkaridis, Hiroshi Taguchi, Arvind Raghunathan, Daniel Nikovski

We propose a Predictive Group Elevator Scheduler by using predictive information of passengers arrivals from a Transformer based destination predictor and a linear regression model that predicts remaining time to destinations.

regression

Imitation and Supervised Learning of Compliance for Robotic Assembly

no code implementations20 Nov 2021 Devesh K. Jha, Diego Romeres, William Yerazunis, Daniel Nikovski

This can be used to learn a suitable representation of the skill that can be generalized to novel positions of one of the parts involved in the assembly, for example the hole in a peg-in-hole (PiH) insertion task.

Industrial Robots Position

Control of Mechanical Systems via Feedback Linearization Based on Black-Box Gaussian Process Models

no code implementations26 Apr 2021 Alberto Dalla Libera, Fabio Amadio, Daniel Nikovski, Ruggero Carli, Diego Romeres

We tested the two strategies on a simulated manipulator with seven degrees of freedom, also varying the GP kernel choice.

Model-based Policy Search for Partially Measurable Systems

no code implementations21 Jan 2021 Fabio Amadio, Alberto Dalla Libera, Ruggero Carli, Daniel Nikovski, Diego Romeres

In this paper, we propose a Model-Based Reinforcement Learning (MBRL) algorithm for Partially Measurable Systems (PMS), i. e., systems where the state can not be directly measured, but must be estimated through proper state observers.

Gaussian Processes Model-based Reinforcement Learning +2

Deep Reactive Planning in Dynamic Environments

no code implementations31 Oct 2020 Kei Ota, Devesh K. Jha, Tadashi Onishi, Asako Kanezaki, Yusuke Yoshiyasu, Yoko SASAKI, Toshisada Mariyama, Daniel Nikovski

The main novelty of the proposed approach is that it allows a robot to learn an end-to-end policy which can adapt to changes in the environment during execution.

Understanding Multi-Modal Perception Using Behavioral Cloning for Peg-In-a-Hole Insertion Tasks

no code implementations22 Jul 2020 Yifang Liu, Diego Romeres, Devesh K. Jha, Daniel Nikovski

One of the main challenges in peg-in-a-hole (PiH) insertion tasks is in handling the uncertainty in the location of the target hole.

Can Increasing Input Dimensionality Improve Deep Reinforcement Learning?

1 code implementation ICML 2020 Kei Ota, Tomoaki Oiki, Devesh K. Jha, Toshisada Mariyama, Daniel Nikovski

We believe that stronger feature propagation together with larger networks (and thus larger search space) allows RL agents to learn more complex functions of states and thus improves the sample efficiency.

Decision Making reinforcement-learning +1

Model-Based Reinforcement Learning for Physical Systems Without Velocity and Acceleration Measurements

no code implementations25 Feb 2020 Alberto Dalla Libera, Diego Romeres, Devesh K. Jha, Bill Yerazunis, Daniel Nikovski

In this paper, we propose a derivative-free model learning framework for Reinforcement Learning (RL) algorithms based on Gaussian Process Regression (GPR).

GPR Model-based Reinforcement Learning +2

Multi-label Prediction in Time Series Data using Deep Neural Networks

no code implementations27 Jan 2020 Wenyu Zhang, Devesh K. Jha, Emil Laftchiev, Daniel Nikovski

In the most general setting of these types of problems, one or more samples of data across multiple time series can be assigned several concurrent fault labels from a finite, known set and the task is to predict the possibility of fault occurrence over a desired time horizon.

Event Detection General Classification +4

Learning Deep Parameterized Skills from Demonstration for Re-targetable Visuomotor Control

2 code implementations23 Oct 2019 Jonathan Chang, Nishanth Kumar, Sean Hastings, Aaron Gokaslan, Diego Romeres, Devesh Jha, Daniel Nikovski, George Konidaris, Stefanie Tellex

We demonstrate that our model trained on 33% of the possible goals is able to generalize to more than 90% of the targets in the scene for both simulation and robot experiments.

Trajectory Optimization for Unknown Constrained Systems using Reinforcement Learning

no code implementations13 Mar 2019 Kei Ota, Devesh K. Jha, Tomoaki Oiki, Mamoru Miura, Takashi Nammoto, Daniel Nikovski, Toshisada Mariyama

Our experiments show that our RL agent trained with a reference path outperformed a model-free PID controller of the type commonly used on many robotic platforms for trajectory tracking.

Motion Planning reinforcement-learning +1

Learning Dynamical Demand Response Model in Real-Time Pricing Program

no code implementations22 Dec 2018 Hanchen Xu, Hongbo Sun, Daniel Nikovski, Kitamura Shoichi, Kazuyuki Mori

In both cases, the dynamical DR model can be learned from historical price and energy consumption data.

Semiparametrical Gaussian Processes Learning of Forward Dynamical Models for Navigating in a Circular Maze

no code implementations13 Sep 2018 Diego Romeres, Devesh Jha, Alberto Dalla Libera, William Yerazunis, Daniel Nikovski

We propose the system presented in the paper as a benchmark problem for reinforcement and robot learning, for its interesting and challenging dynamics and its relative ease of reproducibility.

Friction Gaussian Processes +1

Sim-to-Real Transfer Learning using Robustified Controllers in Robotic Tasks involving Complex Dynamics

no code implementations13 Sep 2018 Jeroen van Baar, Alan Sullivan, Radu Cordorel, Devesh Jha, Diego Romeres, Daniel Nikovski

Another advantage when robots are involved, is that the amount of time a robot is occupied learning a task---rather than being productive---can be reduced by transferring the learned task to the real robot.

Friction Transfer Learning

Random Projection Filter Bank for Time Series Data

no code implementations NeurIPS 2017 Amir-Massoud Farahmand, Sepideh Pourazarm, Daniel Nikovski

Different filters in RPFB extract different aspects of the time series, and together they provide a reasonably good summary of the time series.

Time Series Time Series Prediction

Cannot find the paper you are looking for? You can Submit a new open access paper.