Search Results for author: Sadegh Soudjani

Found 25 papers, 1 papers with code

Temporal Logic Resilience for Dynamical Systems

no code implementations30 Apr 2024 Adnane Saoud, Pushpak Jagtap, Sadegh Soudjani

We use finite temporal logic to express the requirements on the acceptable functionality and define the resilience metric as the maximum disturbance under which the system satisfies the temporal requirements.

Safe Reach Set Computation via Neural Barrier Certificates

no code implementations29 Apr 2024 Alessandro Abate, Sergiy Bogomolov, Alec Edwards, Kostiantyn Potomkin, Sadegh Soudjani, Paolo Zuliani

We present a novel technique for online safety verification of autonomous systems, which performs reachability analysis efficiently for both bounded and unbounded horizons by employing neural barrier certificates.

Autonomous Driving

Data-Driven Distributionally Robust Safety Verification Using Barrier Certificates and Conditional Mean Embeddings

no code implementations15 Mar 2024 Oliver Schön, Zhengang Zhong, Sadegh Soudjani

Algorithmic verification of realistic systems to satisfy safety and other temporal requirements has suffered from poor scalability of the employed formal approaches.

Formal Verification of Unknown Stochastic Systems via Non-parametric Estimation

no code implementations8 Mar 2024 Zhi Zhang, Chenyu Ma, Saleh Soudijani, Sadegh Soudjani

A novel data-driven method for formal verification is proposed to study complex systems operating in safety-critical domains.

Assume-Guarantee Reinforcement Learning

no code implementations15 Dec 2023 Milad Kazemi, Mateo Perez, Fabio Somenzi, Sadegh Soudjani, Ashutosh Trivedi, Alvaro Velasquez

We present a modular approach to \emph{reinforcement learning} (RL) in environments consisting of simpler components evolving in parallel.

reinforcement-learning Reinforcement Learning (RL)

Using Knowledge Awareness to improve Safety of Autonomous Driving

no code implementations25 Oct 2023 Andrea Calvagna, Arabinda Ghosh, Sadegh Soudjani

We present a method, which incorporates knowledge awareness into the symbolic computation of discrete controllers for reactive cyber physical systems, to improve decision making about the unknown operating environment under uncertain/incomplete inputs.

Autonomous Driving Decision Making +1

Generalized Stochastic Dynamic Aggregative Game for Demand-Side Management in Microgrids with Shared Battery

no code implementations4 Oct 2023 Shahram Yadollahi, Hamed Kebriaei, Sadegh Soudjani

In this paper, we focus on modeling and analysis of demand-side management in a microgrid where agents utilize grid energy and a shared battery charged by renewable energy sources.

Management

Safety Barrier Certificates for Stochastic Control Systems with Wireless Communication Networks

no code implementations11 Sep 2023 Omid Akbarzadeh, Sadegh Soudjani, Abolfazl Lavaei

This work is concerned with a formal approach for safety controller synthesis of stochastic control systems with both process and measurement noises while considering wireless communication networks between sensors, controllers, and actuators.

Verifying the Unknown: Correct-by-Design Control Synthesis for Networks of Stochastic Uncertain Systems

no code implementations3 Sep 2023 Oliver Schön, Birgit van Huijgevoort, Sofie Haesaert, Sadegh Soudjani

We address two limitations of existing approaches for formal synthesis of controllers for networks of uncertain systems satisfying complex temporal specifications.

Neural Abstraction-Based Controller Synthesis and Deployment

1 code implementation7 Jul 2023 Rupak Majumdar, Mahmoud Salamati, Sadegh Soudjani

For the selected benchmarks, our approach reduces the memory requirements respectively for the synthesis and deployment by a factor of $1. 31\times 10^5$ and $7. 13\times 10^3$ on average, and up to $7. 54\times 10^5$ and $3. 18\times 10^4$.

Bayesian Formal Synthesis of Unknown Systems via Robust Simulation Relations

no code implementations14 Apr 2023 Oliver Schön, Birgit van Huijgevoort, Sofie Haesaert, Sadegh Soudjani

With a focus on continuous-space stochastic systems with parametric uncertainty, we propose a two-stage approach that decomposes the problem into a learning stage and a robust formal controller synthesis stage.

SySCoRe: Synthesis via Stochastic Coupling Relations

no code implementations23 Feb 2023 Birgit van Huijgevoort, Oliver Schön, Sadegh Soudjani, Sofie Haesaert

We present SySCoRe, a MATLAB toolbox that synthesizes controllers for stochastic continuous-state systems to satisfy temporal logic specifications.

Correct-by-Design Control of Parametric Stochastic Systems

no code implementations15 Oct 2022 Oliver Schön, Birgit van Huijgevoort, Sofie Haesaert, Sadegh Soudjani

We develop new methods for models of systems subject to both stochastic and parametric uncertainties.

Compositional Reinforcement Learning for Discrete-Time Stochastic Control Systems

no code implementations6 Aug 2022 Abolfazl Lavaei, Mateo Perez, Milad Kazemi, Fabio Somenzi, Sadegh Soudjani, Ashutosh Trivedi, Majid Zamani

A key contribution is to leverage the convergence results for adversarial RL (minimax Q-learning) on finite stochastic arenas to provide control strategies maximizing the probability of satisfaction over the network of continuous-space systems.

Q-Learning reinforcement-learning +1

Safety Barrier Certificates for Stochastic Hybrid Systems

no code implementations6 Aug 2022 Abolfazl Lavaei, Sadegh Soudjani, Emilio Frazzoli

In our proposed scheme, we first provide an augmented framework to characterize each stochastic hybrid system containing continuous evolutions and instantaneous jumps with a unified system covering both scenarios.

Constructing MDP Abstractions Using Data with Formal Guarantees

no code implementations29 Jun 2022 Abolfazl Lavaei, Sadegh Soudjani, Emilio Frazzoli, Majid Zamani

We then propose a scenario convex program (SCP) associated to the original RCP by collecting a finite number of data from trajectories of the system.

Data-Driven Abstraction-Based Control Synthesis

no code implementations16 Jun 2022 Milad Kazemi, Rupak Majumdar, Mahmoud Salamati, Sadegh Soudjani, Ben Wooding

The growth bound together with the sampled trajectories are then used to construct the abstraction and synthesise a controller.

Data-driven Safety Verification of Stochastic Systems via Barrier Certificates

no code implementations23 Dec 2021 Ali Salamati, Abolfazl Lavaei, Sadegh Soudjani, Majid Zamani

In this paper, we propose a data-driven approach to formally verify the safety of (potentially) unknown discrete-time continuous-space stochastic systems.

Data-driven verification and synthesis of stochastic systems via barrier certificates

no code implementations19 Nov 2021 Ali Salamati, Abolfazl Lavaei, Sadegh Soudjani, Majid Zamani

In this work, we study verification and synthesis problems for safety specifications over unknown discrete-time stochastic systems.

Symbolic Control for Stochastic Systems via Finite Parity Games

no code implementations4 Jan 2021 Rupak Majumdar, Kaushik Mallik, Anne-Kathrin Schmuck, Sadegh Soudjani

While characterizing the exact satisfaction probability is open, we show that a lower bound on this probability can be obtained by (I) computing an under-approximation of the qualitative winning region, i. e., states from which the parity condition can be enforced almost surely, and (II) computing the maximal probability of reaching this qualitative winning region.

Compositional Construction of Control Barrier Functions for Continuous-Time Stochastic Hybrid Systems

no code implementations14 Dec 2020 Ameneh Nejati, Sadegh Soudjani, Majid Zamani

In this work, we propose a compositional framework for the construction of control barrier functions for networks of continuous-time stochastic hybrid systems enforcing complex logic specifications expressed by finite-state automata.

Data-Driven Verification under Signal Temporal Logic Constraints

no code implementations8 May 2020 Ali Salamati, Sadegh Soudjani, Majid Zamani

Since the dynamics are parameterized and partially unknown, we collect data from the system and employ Bayesian inference techniques to associate a confidence value to the satisfaction of the property.

Bayesian Inference

Formal Policy Synthesis for Continuous-Space Systems via Reinforcement Learning

no code implementations4 May 2020 Milad Kazemi, Sadegh Soudjani

We use this procedure to guide the RL algorithm towards a policy that converges to an optimal policy under suitable assumptions on the process.

reinforcement-learning Reinforcement Learning (RL)

Formal Controller Synthesis for Continuous-Space MDPs via Model-Free Reinforcement Learning

no code implementations2 Mar 2020 Abolfazl Lavaei, Fabio Somenzi, Sadegh Soudjani, Ashutosh Trivedi, Majid Zamani

A key contribution of the paper is to leverage the classical convergence results for reinforcement learning on finite MDPs and provide control strategies maximizing the probability of satisfaction over unknown, continuous-space MDPs while providing probabilistic closeness guarantees.

reinforcement-learning Reinforcement Learning (RL)

Perception-in-the-Loop Adversarial Examples

no code implementations21 Jan 2019 Mahmoud Salamati, Sadegh Soudjani, Rupak Majumdar

We run CMA-ES using human participants to provide the fitness function, using the insight that the choice of best candidates in CMA-ES can be naturally modeled as a perception task: pick the top $k$ inputs perceptually closest to a fixed input.

Cannot find the paper you are looking for? You can Submit a new open access paper.