Search Results for author: Nikolai Matni

Found 37 papers, 16 papers with code

How are policy gradient methods affected by the limits of control?

no code implementations14 Jun 2022 Ingvar Ziemann, Anastasios Tsiamis, Henrik Sandberg, Nikolai Matni

We study stochastic policy gradient methods from the perspective of control-theoretic limitations.

Policy Gradient Methods

Toward Certified Robustness Against Real-World Distribution Shifts

no code implementations8 Jun 2022 Haoze Wu, Teruhiro Tagomori, Alexander Robey, Fengjun Yang, Nikolai Matni, George Pappas, Hamed Hassani, Corina Pasareanu, Clark Barrett

We consider the problem of certifying the robustness of deep neural networks against real-world distribution shifts.

TaSIL: Taylor Series Imitation Learning

1 code implementation30 May 2022 Daniel Pfrommer, Thomas T. C. K. Zhang, Stephen Tu, Nikolai Matni

We propose Taylor Series Imitation Learning (TaSIL), a simple augmentation to standard behavior cloning losses in the context of continuous control.

Continuous Control Imitation Learning

Risk of Stochastic Systems for Temporal Logic Specifications

no code implementations28 May 2022 Lars Lindemann, Lejun Jiang, Nikolai Matni, George J. Pappas

For discrete-time stochastic processes, we show under which conditions the approximate STL robustness risk can even be computed exactly.

Autonomous Driving

Learning to Control Linear Systems can be Hard

no code implementations27 May 2022 Anastasios Tsiamis, Ingvar Ziemann, Manfred Morari, Nikolai Matni, George J. Pappas

In this paper, we study the statistical difficulty of learning to control linear systems.

online learning

Robust Model Predictive Control with Polytopic Model Uncertainty through System Level Synthesis

1 code implementation21 Mar 2022 Shaoru Chen, Victor M. Preciado, Manfred Morari, Nikolai Matni

We propose a novel method for robust model predictive control (MPC) of uncertain systems subject to both polytopic model uncertainty and additive disturbances.

Performance-Robustness Tradeoffs in Adversarially Robust Linear-Quadratic Control

no code implementations21 Mar 2022 Bruce D. Lee, Thomas T. C. K. Zhang, Hamed Hassani, Nikolai Matni

Though this fundamental tradeoff between nominal performance and robustness is known to exist, it is not well-characterized in quantitative terms.

Uncertainty-driven Planner for Exploration and Navigation

1 code implementation24 Feb 2022 Georgios Georgakis, Bernadette Bucher, Anton Arapin, Karl Schmeckpeper, Nikolai Matni, Kostas Daniilidis

We consider the problems of exploration and point-goal navigation in previously unseen environments, where the spatial complexity of indoor scenes and partial observability constitute these tasks challenging.

Single Trajectory Nonparametric Learning of Nonlinear Dynamics

no code implementations16 Feb 2022 Ingvar Ziemann, Henrik Sandberg, Nikolai Matni

Given a single trajectory of a dynamical system, we analyze the performance of the nonparametric least squares estimator (LSE).

Linear Variational State-Space Filtering

1 code implementation4 Jan 2022 Daniel Pfrommer, Nikolai Matni

We introduce Variational State-Space Filters (VSSF), a new method for unsupervised learning, identification, and filtering of latent Markov state space models from raw pixels.

Data-driven Distributed and Localized Model Predictive Control

2 code implementations22 Dec 2021 Carmen Amo Alonso, Fengjun Yang, Nikolai Matni

By imposing locality constraints on the system response, we show that the amount of data needed for our synthesis problem is independent of the size of the global system.

Adversarially Robust Stability Certificates can be Sample-Efficient

no code implementations20 Dec 2021 Thomas T. C. K. Zhang, Stephen Tu, Nicholas M. Boffi, Jean-Jacques E. Slotine, Nikolai Matni

Motivated by bridging the simulation to reality gap in the context of safety-critical systems, we consider learning adversarially robust stability certificates for unknown nonlinear dynamical systems.

Learning Robust Output Control Barrier Functions from Safe Expert Demonstrations

1 code implementation18 Nov 2021 Lars Lindemann, Alexander Robey, Lejun Jiang, Stephen Tu, Nikolai Matni

We then present an optimization problem to learn ROCBFs from expert demonstrations that exhibit safe system behavior, e. g., data collected from a human operator.

Autonomous Driving

Adversarial Tradeoffs in Linear Inverse Problems and Robust State Estimation

no code implementations17 Nov 2021 Bruce D. Lee, Thomas T. C. K. Zhang, Hamed Hassani, Nikolai Matni

Adversarially robust training has been shown to reduce the susceptibility of learned models to targeted input data perturbations.

System Level Synthesis-based Robust Model Predictive Control through Convex Inner Approximation

1 code implementation10 Nov 2021 Shaoru Chen, Nikolai Matni, Manfred Morari, Victor M. Preciado

We propose a robust model predictive control (MPC) method for discrete-time linear time-invariant systems with norm-bounded additive disturbances and model uncertainty.

Communication Topology Co-Design in Graph Recurrent Neural Network Based Distributed Control

1 code implementation28 Apr 2021 Fengjun Yang, Nikolai Matni

Our proposed parameterization enjoys a local and distributed architecture, similar to previous Graph Neural Network (GNN)-based parameterizations, while further naturally allowing for joint optimization of the distributed controller and communication topology needed to implement it.

STL Robustness Risk over Discrete-Time Stochastic Processes

no code implementations3 Apr 2021 Lars Lindemann, Nikolai Matni, George J. Pappas

We then define the risk of a stochastic process not satisfying an STL formula robustly, referred to as the STL robustness risk.

How Are Learned Perception-Based Controllers Impacted by the Limits of Robust Control?

1 code implementation2 Apr 2021 Jingxi Xu, Bruce Lee, Nikolai Matni, Dinesh Jayaraman

The difficulty of optimal control problems has classically been characterized in terms of system properties such as minimum eigenvalues of controllability/observability gramians.

On the Sample Complexity of Stability Constrained Imitation Learning

no code implementations18 Feb 2021 Stephen Tu, Alexander Robey, Tingnan Zhang, Nikolai Matni

We study the following question in the context of imitation learning for continuous control: how are the underlying stability properties of an expert policy reflected in the sample-complexity of an imitation learning task?

Continuous Control Generalization Bounds +1

Learning Robust Hybrid Control Barrier Functions for Uncertain Systems

1 code implementation16 Jan 2021 Alexander Robey, Lars Lindemann, Stephen Tu, Nikolai Matni

We identify sufficient conditions on the data such that feasibility of the optimization problem ensures correctness of the learned robust hybrid control barrier functions.

Data-Driven System Level Synthesis

1 code implementation20 Nov 2020 Anton Xue, Nikolai Matni

We establish data-driven versions of the System Level Synthesis (SLS) parameterization of achievable closed-loop system responses for a linear-time-invariant system over a finite-horizon.

Learning Hybrid Control Barrier Functions from Data

no code implementations8 Nov 2020 Lars Lindemann, Haimin Hu, Alexander Robey, Hanwen Zhang, Dimos V. Dimarogonas, Stephen Tu, Nikolai Matni

Motivated by the lack of systematic tools to obtain safe control laws for hybrid systems, we propose an optimization-based framework for learning certifiably safe control laws from data.

Learning Stability Certificates from Data

no code implementations13 Aug 2020 Nicholas M. Boffi, Stephen Tu, Nikolai Matni, Jean-Jacques E. Slotine, Vikas Sindhwani

Many existing tools in nonlinear control theory for establishing stability or safety of a dynamical system can be distilled to the construction of a certificate function that guarantees a desired property.

Learning Control Barrier Functions from Expert Demonstrations

1 code implementation7 Apr 2020 Alexander Robey, Haimin Hu, Lars Lindemann, Hanwen Zhang, Dimos V. Dimarogonas, Stephen Tu, Nikolai Matni

Furthermore, if the CBF parameterization is convex, then under mild assumptions, so is our learning process.

An Adversarial Objective for Scalable Exploration

1 code implementation13 Mar 2020 Bernadette Bucher, Karl Schmeckpeper, Nikolai Matni, Kostas Daniilidis

Model-based curiosity combines active learning approaches to optimal sampling with the information gain based incentives for exploration presented in the curiosity literature.

Active Learning

PAC Confidence Sets for Deep Neural Networks via Calibrated Prediction

1 code implementation ICLR 2020 Sangdon Park, Osbert Bastani, Nikolai Matni, Insup Lee

We propose an algorithm combining calibrated prediction and generalization bounds from learning theory to construct confidence sets for deep neural networks with PAC guarantees---i. e., the confidence set for a given input contains the true label with high probability.

Generalization Bounds Learning Theory +2

Sample Complexity of Kalman Filtering for Unknown Systems

no code implementations L4DC 2020 Anastasios Tsiamis, Nikolai Matni, George J. Pappas

We show that when the system identification step produces sufficiently accurate estimates, or when the underlying true KF is sufficiently robust, that a Certainty Equivalent (CE) KF, i. e., one designed using the estimated parameters directly, enjoys provable sub-optimality guarantees.

Efficient Learning of Distributed Linear-Quadratic Controllers

no code implementations21 Sep 2019 Salar Fattahi, Nikolai Matni, Somayeh Sojoudi

In this work, we propose a robust approach to design distributed controllers for unknown-but-sparse linear and time-invariant systems.

Robust Guarantees for Perception-Based Control

no code implementations L4DC 2020 Sarah Dean, Nikolai Matni, Benjamin Recht, Vickie Ye

Motivated by vision-based control of autonomous vehicles, we consider the problem of controlling a known linear dynamical system for which partial state information, such as vehicle position, is extracted from complex and nonlinear data, such as a camera image.

Autonomous Vehicles

A Tutorial on Concentration Bounds for System Identification

no code implementations27 Jun 2019 Nikolai Matni, Stephen Tu

We provide a brief tutorial on the use of concentration inequalities as they apply to system identification of state-space parameters of linear time invariant systems, with a focus on the fully observed setting.

From self-tuning regulators to reinforcement learning and back again

no code implementations27 Jun 2019 Nikolai Matni, Alexandre Proutiere, Anders Rantzer, Stephen Tu

Machine and reinforcement learning (RL) are increasingly being applied to plan and control the behavior of autonomous systems interacting with the physical world.

reinforcement-learning

Learning Sparse Dynamical Systems from a Single Sample Trajectory

no code implementations20 Apr 2019 Salar Fattahi, Nikolai Matni, Somayeh Sojoudi

In particular, we show that the proposed estimator can correctly identify the sparsity pattern of the system matrices with high probability, provided that the length of the sample trajectory exceeds a threshold.

Safely Learning to Control the Constrained Linear Quadratic Regulator

2 code implementations26 Sep 2018 Sarah Dean, Stephen Tu, Nikolai Matni, Benjamin Recht

We study the constrained linear quadratic regulator with unknown dynamics, addressing the tension between safety and exploration in data-driven control techniques.

Regret Bounds for Robust Adaptive Control of the Linear Quadratic Regulator

no code implementations NeurIPS 2018 Sarah Dean, Horia Mania, Nikolai Matni, Benjamin Recht, Stephen Tu

We consider adaptive control of the Linear Quadratic Regulator (LQR), where an unknown linear system is controlled subject to quadratic costs.

Finite-Data Performance Guarantees for the Output-Feedback Control of an Unknown System

1 code implementation25 Mar 2018 Ross Boczar, Nikolai Matni, Benjamin Recht

As the systems we control become more complex, first-principle modeling becomes either impossible or intractable, motivating the use of machine learning techniques for the control of systems with continuous action spaces.

On the Sample Complexity of the Linear Quadratic Regulator

no code implementations4 Oct 2017 Sarah Dean, Horia Mania, Nikolai Matni, Benjamin Recht, Stephen Tu

This paper addresses the optimal control problem known as the Linear Quadratic Regulator in the case when the dynamics are unknown.

Convex Relaxations of SE(2) and SE(3) for Visual Pose Estimation

no code implementations15 Jan 2014 Matanya B. Horowitz, Nikolai Matni, Joel W. Burdick

The method is a convex relaxation of the classical pose estimation problem, and is based on explicit linear matrix inequality (LMI) representations for the convex hulls of $SE(2)$ and $SE(3)$.

Pose Estimation

Cannot find the paper you are looking for? You can Submit a new open access paper.