Search Results for author: Mouhacine Benosman

Found 18 papers, 2 papers with code

Finite-Time Convergence in Continuous-Time Optimization

no code implementations ICML 2020 Orlando Romero, Mouhacine Benosman

In this paper, we investigate a Lyapunov-like differential inequality that allows us to establish finite-time stability of a continuous-time state-space dynamical system represented via a multivariate ordinary differential equation or differential inclusion.

Policy Optimization for PDE Control with a Warm Start

no code implementations1 Mar 2024 Xiangyuan Zhang, Saviz Mowlavi, Mouhacine Benosman, Tamer Başar

The PO step fine-tunes the model-based controller to compensate for the modeling error from dimensionality reduction.

Dimensionality Reduction

Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularization

no code implementations23 Feb 2024 Xiaoyu Xie, Saviz Mowlavi, Mouhacine Benosman

Spatiotemporal modeling is critical for understanding complex systems across various scientific and engineering disciplines, but governing equations are often not fully known or computationally intractable due to inherent system complexity.

Operator learning

Dual parametric and state estimation for partial differential equations

no code implementations19 Dec 2023 Saviz Mowlavi, Mouhacine Benosman

Designing estimation algorithms for systems governed by partial differential equations (PDEs) such as fluid flows is challenging due to the high-dimensional and oftentimes nonlinear nature of the dynamics, as well as their dependence on unobserved physical parameters.

Controlgym: Large-Scale Control Environments for Benchmarking Reinforcement Learning Algorithms

1 code implementation30 Nov 2023 Xiangyuan Zhang, Weichao Mao, Saviz Mowlavi, Mouhacine Benosman, Tamer Başar

This project serves the learning for dynamics & control (L4DC) community, aiming to explore key questions: the convergence of RL algorithms in learning control policies; the stability and robustness issues of learning-based controllers; and the scalability of RL algorithms to high- and potentially infinite-dimensional systems.

Benchmarking OpenAI Gym +1

Global Convergence of Receding-Horizon Policy Search in Learning Estimator Designs

1 code implementation9 Sep 2023 Xiangyuan Zhang, Saviz Mowlavi, Mouhacine Benosman, Tamer Başar

We introduce the receding-horizon policy gradient (RHPG) algorithm, the first PG algorithm with provable global convergence in learning the optimal linear estimator designs, i. e., the Kalman filter (KF).

Reinforcement learning-based estimation for partial differential equations

no code implementations20 Jan 2023 Saviz Mowlavi, Mouhacine Benosman

In systems governed by nonlinear partial differential equations such as fluid flows, the design of state estimators such as Kalman filters relies on a reduced-order model (ROM) that projects the original high-dimensional dynamics onto a computationally tractable low-dimensional space.

reinforcement-learning Reinforcement Learning (RL)

Reinforcement Learning State Estimation for High-Dimensional Nonlinear Systems

no code implementations29 Sep 2021 Saviz Mowlavi, Mouhacine Benosman, Saleh Nabi

In high-dimensional nonlinear systems such as fluid flows, the design of state estimators such as Kalman filters relies on a reduced-order model (ROM) of the dynamics.

reinforcement-learning Reinforcement Learning (RL) +1

First-Order Optimization Algorithms via Discretization of Finite-Time Convergent Flows

no code implementations1 Jan 2021 Mouhacine Benosman, Orlando Romero, Anoop Cherian

In this paper, we investigate in the context of deep neural networks, the performance of several discretization algorithms for two first-order finite-time optimization flows.

Finite-time Newton seeking control

no code implementations17 Dec 2020 Martin Guay, Mouhacine Benosman

The averaged Newton seeking system is shown to achieve finite-time stability of the unknown optimum of the static map.

Optimization and Control

Robust Constrained-MDPs: Soft-Constrained Robust Policy Optimization under Model Uncertainty

no code implementations10 Oct 2020 Reazul Hasan Russel, Mouhacine Benosman, Jeroen van Baar

In this paper, we focus on the problem of robustifying reinforcement learning (RL) algorithms with respect to model uncertainties.

Management Reinforcement Learning (RL)

First-Order Optimization Inspired from Finite-Time Convergent Flows

no code implementations6 Oct 2020 Siqi Zhang, Mouhacine Benosman, Orlando Romero, Anoop Cherian

In this paper, we investigate the performance of two first-order optimization algorithms, obtained from forward Euler discretization of finite-time optimization flows.

Safe Learning-based Observers for Unknown Nonlinear Systems using Bayesian Optimization

no code implementations12 May 2020 Ankush Chakrabarty, Mouhacine Benosman

Data generated from dynamical systems with unknown dynamics enable the learning of state observers that are: robust to modeling error, computationally tractable to design, and capable of operating with guaranteed performance.

Bayesian Optimization Gaussian Processes

Finite-Time Convergence of Continuous-Time Optimization Algorithms via Differential Inclusions

no code implementations18 Dec 2019 Orlando Romero, Mouhacine Benosman

In this paper, we propose two discontinuous dynamical systems in continuous time with guaranteed prescribed finite-time local convergence to strict local minima of a given cost function.

Cannot find the paper you are looking for? You can Submit a new open access paper.