Search Results for author: Sandra Hirche

Found 63 papers, 9 papers with code

Risk-averse Learning with Non-Stationary Distributions

no code implementations3 Apr 2024 Siyi Wang, Zifan Wang, Xinlei Yi, Michael M. Zavlanos, Karl H. Johansson, Sandra Hirche

Considering non-stationary environments in online optimization enables decision-maker to effectively adapt to changes and improve its performance over time.

Time-Robust Path Planning with Piece-Wise Linear Trajectory for Signal Temporal Logic Specifications

no code implementations15 Mar 2024 Nhan-Khanh Le, Erfaun Noorani, Sandra Hirche, John Baras

We study time-robust path planning for synthesizing robots' trajectories that adhere to spatial-temporal specifications expressed in Signal Temporal Logic (STL).

Infinite-horizon optimal scheduling for feedback control

no code implementations13 Feb 2024 Siyi Wang, Sandra Hirche

Moreover, by the diagonal system matrix assumption, the optimal scheduling policy is shown to be of threshold type.

Scheduling

Whom to Trust? Elective Learning for Distributed Gaussian Process Regression

no code implementations5 Feb 2024 Zewen Yang, Xiaobing Dai, Akshat Dubey, Sandra Hirche, Georges Hattab

This paper introduces an innovative approach to enhance distributed cooperative learning using Gaussian process (GP) regression in multi-agent systems (MASs).

regression

Cooperative Learning with Gaussian Processes for Euler-Lagrange Systems Tracking Control under Switching Topologies

no code implementations5 Feb 2024 Zewen Yang, Songbo Dong, Armin Lederer, Xiaobing Dai, Siyu Chen, Stefan Sosnowski, Georges Hattab, Sandra Hirche

This work presents an innovative learning-based approach to tackle the tracking control problem of Euler-Lagrange multi-agent systems with partially unknown dynamics operating under switching communication topologies.

Gaussian Processes

Innovation-triggered Learning for Data-driven Predictive Control: Deterministic and Stochastic Formulations

no code implementations29 Jan 2024 Kaikai Zheng, Dawei Shi, Sandra Hirche, Yang Shi

Two kinds of data selection mechanisms are proposed by online evaluating the innovation contained in the sampled data, wherein the innovation is quantified by its effect of shrinking the set of potential system dynamics that are compatible with the sampled data.

H2 suboptimal containment control of homogeneous and heterogeneous multi-agent systems

no code implementations19 Nov 2023 Yuan Gao, Junjie Jiao, Zhongkui Li, Sandra Hirche

The aim is to design a distributed protocol by dynamic output feedback that achieves state/output containment control while the associated H2 cost is smaller than an a priori given upper bound.

Safe Online Dynamics Learning with Initially Unknown Models and Infeasible Safety Certificates

no code implementations3 Nov 2023 Alexandre Capone, Ryan Cosner, Aaron Ames, Sandra Hirche

Our approach requires no prior model and corresponds, to the best of our knowledge, to the first algorithm that guarantees safety in settings with occasionally infeasible safety certificates without requiring a backup non-learning-based controller.

Bayesian Optimization

Risk-Sensitive Inhibitory Control for Safe Reinforcement Learning

no code implementations2 Oct 2023 Armin Lederer, Erfaun Noorani, John S. Baras, Sandra Hirche

We propose a method for learning these value functions using common techniques from reinforcement learning and derive sufficient conditions for its success.

reinforcement-learning Safe Reinforcement Learning

Episodic Gaussian Process-Based Learning Control with Vanishing Tracking Errors

no code implementations10 Jul 2023 Armin Lederer, Jonas Umlauft, Sandra Hirche

We address this issue by deriving a Bayesian prediction error bound for GP regression, which we show to decay with the growth of a novel, kernel-based measure of data density.

regression

Koopman Kernel Regression

1 code implementation NeurIPS 2023 Petar Bevanda, Max Beier, Armin Lederer, Stefan Sosnowski, Eyke Hüllermeier, Sandra Hirche

Many machine learning approaches for decision making, such as reinforcement learning, rely on simulators or predictive models to forecast the time-evolution of quantities of interest, e. g., the state of an agent or the reward of a policy.

Decision Making regression

Can Learning Deteriorate Control? Analyzing Computational Delays in Gaussian Process-Based Event-Triggered Online Learning

no code implementations14 May 2023 Xiaobing Dai, Armin Lederer, Zewen Yang, Sandra Hirche

When the dynamics of systems are unknown, supervised machine learning techniques are commonly employed to infer models from data.

Time Series Classification for Detecting Parkinson's Disease from Wrist Motions

1 code implementation21 Apr 2023 Cedric Donié, Neha Das, Satoshi Endo, Sandra Hirche

We used a random search to find the highest-scoring InceptionTime architecture and compared it to ROCKET with a ridge classifier and a multi-layer perceptron (MLP) on wrist motions of PD patients.

Time Series Time Series Classification

Distributed Coverage Control of Constrained Constant-Speed Unicycle Multi-Agent Systems

no code implementations12 Apr 2023 Qingchen Liu, Zengjie Zhang, Nhan Khanh Le, Jiahu Qin, Fangzhou Liu, Sandra Hirche

This paper proposes a novel distributed coverage controller for a multi-agent system with constant-speed unicycle robots (CSUR).

Fast IMU-based Dual Estimation of Human Motion and Kinematic Parameters via Progressive In-Network Computing

no code implementations11 Apr 2023 Xiaobing Dai, Huanzhuo Wu, Siyi Wang, Junjie Jiao, Giang T. Nguyen, Frank H. P. Fitzek, Sandra Hirche

We adopt the concept of field Kalman filtering, where the dual estimation problem is decomposed into a fast state estimation process and a computationally expensive parameter estimation process.

Cooperative Online Learning for Multi-Agent System Control via Gaussian Processes with Event-Triggered Mechanism: Extended Version

no code implementations11 Apr 2023 Xiaobing Dai, Zewen Yang, Sandra Hirche

In the realm of the cooperative control of multi-agent systems (MASs) with unknown dynamics, Gaussian process (GP) regression is widely used to infer the uncertainties due to its modeling flexibility of nonlinear functions and the existence of a theoretical prediction error bound.

Gaussian Processes regression

Learning-Based Optimal Control with Performance Guarantees for Unknown Systems with Latent States

1 code implementation31 Mar 2023 Robert Lefringhausen, Supitsana Srithasan, Armin Lederer, Sandra Hirche

As control engineering methods are applied to increasingly complex systems, data-driven approaches for system identification appear as a promising alternative to physics-based modeling.

Average Communication Rate for Event-Triggered Stochastic Control Systems

no code implementations13 Jan 2023 Zengjie Zhang, Qingchen Liu, Mohammad H. Mamduhi, Sandra Hirche

Quantifying the average communication rate (ACR) of a networked event-triggered stochastic control system (NET-SCS) with deterministic thresholds is challenging due to the non-stationary nature of the system's stochastic processes.

Safe Learning-Based Control of Elastic Joint Robots via Control Barrier Functions

no code implementations1 Dec 2022 Armin Lederer, Azra Begzadić, Neha Das, Sandra Hirche

Ensuring safety is of paramount importance in physical human-robot interaction applications.

Physically Consistent Learning of Conservative Lagrangian Systems with Gaussian Processes

no code implementations24 Jun 2022 Giulio Evangelisti, Sandra Hirche

This paper proposes a physically consistent Gaussian Process (GP) enabling the identification of uncertain Lagrangian systems.

Gaussian Processes

Networked Online Learning for Control of Safety-Critical Resource-Constrained Systems based on Gaussian Processes

no code implementations23 Feb 2022 Armin Lederer, Mingmin Zhang, Samuel Tesfazgi, Sandra Hirche

Safety-critical technical systems operating in unknown environments require the ability to quickly adapt their behavior, which can be achieved in control by inferring a model online from the data stream generated during operation.

Gaussian Processes Management

Towards Data-driven LQR with Koopmanizing Flows

no code implementations27 Jan 2022 Petar Bevanda, Max Beier, Shahab Heshmati-Alamdari, Stefan Sosnowski, Sandra Hirche

To utilize it for efficient LTI control design, we learn a finite representation of the Koopman operator that is linear in controls while concurrently learning meaningful lifting coordinates.

Structure-Preserving Learning Using Gaussian Processes and Variational Integrators

no code implementations10 Dec 2021 Jan Brüdigam, Martin Schuck, Alexandre Capone, Stefan Sosnowski, Sandra Hirche

When using Gaussian process regression to learn unknown systems, a commonly considered approach consists of learning the residual dynamics after applying some generic discretization technique, which might however disregard properties of the underlying physical system.

Gaussian Processes regression

Diffeomorphically Learning Stable Koopman Operators

1 code implementation8 Dec 2021 Petar Bevanda, Max Beier, Sebastian Kerz, Armin Lederer, Stefan Sosnowski, Sandra Hirche

System representations inspired by the infinite-dimensional Koopman operator (generator) are increasingly considered for predictive modeling.

Operator learning

Adaptive Low-Pass Filtering using Sliding Window Gaussian Processes

no code implementations5 Nov 2021 Alejandro J. Ordóñez-Conejo, Armin Lederer, Sandra Hirche

To reduce noise, low-pass filters are commonly employed in order to attenuate high frequency components in the incoming signal, regardless if they come from noise or the actual signal.

Gaussian Processes

Learning the Koopman Eigendecomposition: A Diffeomorphic Approach

no code implementations15 Oct 2021 Petar Bevanda, Johannes Kirmayr, Stefan Sosnowski, Sandra Hirche

We present a novel data-driven approach for learning linear representations of a class of stable nonlinear systems using Koopman eigenfunctions.

Personalized Rehabilitation Robotics based on Online Learning Control

no code implementations1 Oct 2021 Samuel Tesfazgi, Armin Lederer, Johannes F. Kunz, Alejandro J. Ordóñez-Conejo, Sandra Hirche

The use of rehabilitation robotics in clinical applications gains increasing importance, due to therapeutic benefits and the ability to alleviate labor-intensive works.

Gaussian Process Uniform Error Bounds with Unknown Hyperparameters for Safety-Critical Applications

1 code implementation6 Sep 2021 Alexandre Capone, Armin Lederer, Sandra Hirche

Our approach computes a confidence region in the space of hyperparameters, which enables us to obtain a probabilistic upper bound for the model error of a Gaussian process with arbitrary hyperparameters.

Gaussian Processes

Distributed Value of Information in Feedback Control over Multi-hop Networks

no code implementations16 Jul 2021 Precious Ugo Abara, Sandra Hirche

In this paper we propose a distributed value of information (dVoI) metric for the joint design of control and schedulers for medium access in a multi-loop system and multi-hop network.

Scheduling

FedXGBoost: Privacy-Preserving XGBoost for Federated Learning

no code implementations20 Jun 2021 Nhan Khanh Le, Yang Liu, Quang Minh Nguyen, Qingchen Liu, Fangzhou Liu, Quanwei Cai, Sandra Hirche

Federated learning is the distributed machine learning framework that enables collaborative training across multiple parties while ensuring data privacy.

Federated Learning Privacy Preserving

Distributed Bayesian Online Learning for Cooperative Manipulation

no code implementations9 Apr 2021 Pablo Budde gen. Dohmann, Armin Lederer, Marcel Dißemond, Sandra Hirche

To overcome this shortcoming, we propose a novel distributed learning framework for the exemplary task of cooperative manipulation using Bayesian principles.

Inverse Reinforcement Learning: A Control Lyapunov Approach

no code implementations9 Apr 2021 Samuel Tesfazgi, Armin Lederer, Sandra Hirche

A common approach to solve this problem is the framework of inverse reinforcement learning (IRL), where the observed agent, e. g., a human demonstrator, is assumed to behave according to an intrinsic cost function that reflects its intent and informs its control actions.

reinforcement-learning Reinforcement Learning (RL)

Value of information in networked control systems subject to delay

no code implementations7 Apr 2021 Siyi Wang, Qingchen Liu, Precious Ugo Abara, John S. Baras, Sandra Hirche

In this paper, we study the trade-off between the transmission cost and the control performance of the multi-loop networked control system subject to network-induced delay.

Scheduling

Safe Online Learning-based Formation Control of Multi-Agent Systems with Gaussian Processes

no code implementations31 Mar 2021 Thomas Beckers, Sandra Hirche, Leonardo Colombo

Formation control algorithms for multi-agent systems have gained much attention in the recent years due to the increasing amount of mobile and aerial robotic swarms.

Gaussian Processes

Distributed Learning Consensus Control for Unknown Nonlinear Multi-Agent Systems based on Gaussian Processes

no code implementations29 Mar 2021 Zewen Yang, Stefan Sosnowski, Qingchen Liu, Junjie Jiao, Armin Lederer, Sandra Hirche

In this paper, a distributed learning leader-follower consensus protocol based on Gaussian process regression for a class of nonlinear multi-agent systems with unknown dynamics is designed.

Gaussian Processes regression

Koopman Operator Dynamical Models: Learning, Analysis and Control

no code implementations4 Feb 2021 Petar Bevanda, Stefan Sosnowski, Sandra Hirche

The Koopman operator allows for handling nonlinear systems through a (globally) linear representation.

Uniform Error and Posterior Variance Bounds for Gaussian Process Regression with Application to Safe Control

no code implementations13 Jan 2021 Armin Lederer, Jonas Umlauft, Sandra Hirche

In application areas where data generation is expensive, Gaussian processes are a preferred supervised learning model due to their high data-efficiency.

Gaussian Processes regression

The Impact of Data on the Stability of Learning-Based Control- Extended Version

no code implementations20 Nov 2020 Armin Lederer, Alexandre Capone, Thomas Beckers, Jonas Umlauft, Sandra Hirche

In this paper, we propose a Lyapunov-based measure for quantifying the impact of data on the certifiable control performance.

Gaussian Processes

Deep Learning based Uncertainty Decomposition for Real-time Control

no code implementations6 Oct 2020 Neha Das, Jonas Umlauft, Armin Lederer, Thomas Beckers, Sandra Hirche

Data-driven control in unknown environments requires a clear understanding of the involved uncertainties for ensuring safety and efficient exploration.

Efficient Exploration

Online learning-based trajectory tracking for underactuated vehicles with uncertain dynamics

no code implementations14 Sep 2020 Thomas Beckers, Leonardo Colombo, Sandra Hirche, George J. Pappas

To overcome this issue, we present a tracking control law for underactuated rigid-body dynamics using an online learning-based oracle for the prediction of the unknown dynamics.

Anticipating the Long-Term Effect of Online Learning in Control

no code implementations24 Jul 2020 Alexandre Capone, Sandra Hirche

Control schemes that learn using measurement data collected online are increasingly promising for the control of complex and uncertain systems.

Prediction with Approximated Gaussian Process Dynamical Models

no code implementations25 Jun 2020 Thomas Beckers, Sandra Hirche

The modeling and simulation of dynamical systems is a necessary step for many control approaches.

Real-Time Regression with Dividing Local Gaussian Processes

no code implementations16 Jun 2020 Armin Lederer, Alejandro Jose Ordonez Conejo, Korbinian Maier, Wenxin Xiao, Jonas Umlauft, Sandra Hirche

The increased demand for online prediction and the growing availability of large data sets drives the need for computationally efficient models.

Gaussian Processes regression

Learning Stable Nonparametric Dynamical Systems with Gaussian Process Regression

no code implementations14 Jun 2020 Wenxin Xiao, Armin Lederer, Sandra Hirche

Modelling real world systems involving humans such as biological processes for disease treatment or human behavior for robotic rehabilitation is a challenging problem because labeled training data is sparse and expensive, while high prediction accuracy is required from models of these dynamical systems.

regression

GP3: A Sampling-based Analysis Framework for Gaussian Processes

no code implementations14 Jun 2020 Armin Lederer, Markus Kessler, Sandra Hirche

In order to overcome this issue, we propose a novel framework called GP3, general purpose computation on graphics processing units for Gaussian processes, which allows to solve many of the existing problems efficiently.

Computational Efficiency Gaussian Processes

Parameter Optimization for Learning-based Control of Control-Affine Systems

no code implementations L4DC 2020 Armin Lederer, Alexandre Capone, Sandra Hirche

By relaxing the problem through scenario optimization we derive a provably optimal method for control parameter tuning.

regression

Smart Forgetting for Safe Online Learning with Gaussian Processes

no code implementations L4DC 2020 Jonas Umlauft, Thomas Beckers, Alexandre Capone, Armin Lederer, Sandra Hirche

The identification of unknown dynamical systems using supervised learning enables model-based control of systems that cannot be modeled based on first principles.

Computational Efficiency Gaussian Processes

How Training Data Impacts Performance in Learning-based Control

no code implementations25 May 2020 Armin Lederer, Alexandre Capone, Jonas Umlauft, Sandra Hirche

When first principle models cannot be derived due to the complexity of the real system, data-driven methods allow us to build models from system observations.

Localized active learning of Gaussian process state space models

no code implementations L4DC 2020 Alexandre Capone, Jonas Umlauft, Thomas Beckers, Armin Lederer, Sandra Hirche

We apply the proposed method to explore the state space of various dynamical systems and compare our approach to a commonly used entropy-based exploration strategy.

Active Learning Model Predictive Control

Closed-loop Model Selection for Kernel-based Models using Bayesian Optimization

no code implementations12 Sep 2019 Thomas Beckers, Somil Bansal, Claire J. Tomlin, Sandra Hirche

In this work, we present a framework to optimize the kernel and hyperparameters of a kernel-based model directly with respect to the closed-loop performance of the model.

Bayesian Optimization Model Selection

Posterior Variance Analysis of Gaussian Processes with Application to Average Learning Curves

no code implementations4 Jun 2019 Armin Lederer, Jonas Umlauft, Sandra Hirche

The posterior variance of Gaussian processes is a valuable measure of the learning error which is exploited in various applications such as safe reinforcement learning and control design.

Gaussian Processes reinforcement-learning +2

Uniform Error Bounds for Gaussian Process Regression with Application to Safe Control

no code implementations NeurIPS 2019 Armin Lederer, Jonas Umlauft, Sandra Hirche

Finally, we derive safety conditions for the control of unknown dynamical systems based on Gaussian process models and evaluate them in simulations of a robotic manipulator.

Gaussian Processes regression

Mean Square Prediction Error of Misspecified Gaussian Process Models

no code implementations16 Nov 2018 Thomas Beckers, Jonas Umlauft, Sandra Hirche

A naturally provided model confidence is highly relevant for system-theoretical considerations to provide guarantees for application scenarios.

regression valid

A Multi-layer Gaussian Process for Motor Symptom Estimation in People with Parkinson's Disease

no code implementations31 Aug 2018 Muriel Lang, Franz M. J. Pfister, Jakob Fröhner, Kian Abedinpour, Daniel Pichler, Urban Fietzek, Terry T. Um, Dana Kulić, Satoshi Endo, Sandra Hirche

The assessment of Parkinson's disease (PD) poses a significant challenge as it is influenced by various factors which lead to a complex and fluctuating symptom manifestation.

Management

Stable Gaussian Process based Tracking Control of Euler-Lagrange Systems

1 code implementation19 Jun 2018 Thomas Beckers, Dana Kulić, Sandra Hirche

The model fidelity is used to adapt the feedback gains allowing low feedback gains in state space regions of high model confidence.

Inverse Optimal Control with Incomplete Observations

2 code implementations21 Mar 2018 Wanxin Jin, Dana Kulić, Shaoshuai Mou, Sandra Hirche

We handle the problem by proposing the recovery matrix, which establishes a relationship between available observations of the trajectory and weights of given candidate features.

Robotics Systems and Control

Learning Stable Stochastic Nonlinear Dynamical Systems

no code implementations ICML 2017 Jonas Umlauft, Sandra Hirche

A data-driven identification of dynamical systems requiring only minimal prior knowledge is promising whenever no analytically derived model structure is available, e. g., from first principles in physics.

Data Augmentation of Wearable Sensor Data for Parkinson's Disease Monitoring using Convolutional Neural Networks

2 code implementations2 Jun 2017 Terry Taewoong Um, Franz Michael Josef Pfister, Daniel Pichler, Satoshi Endo, Muriel Lang, Sandra Hirche, Urban Fietzek, Dana Kulić

While convolutional neural networks (CNNs) have been successfully applied to many challenging classification applications, they typically require large datasets for training.

Classification Data Augmentation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.