no code implementations • 30 Apr 2024 • Adnane Saoud, Pushpak Jagtap, Sadegh Soudjani
We use finite temporal logic to express the requirements on the acceptable functionality and define the resilience metric as the maximum disturbance under which the system satisfies the temporal requirements.
no code implementations • 29 Apr 2024 • Alessandro Abate, Sergiy Bogomolov, Alec Edwards, Kostiantyn Potomkin, Sadegh Soudjani, Paolo Zuliani
We present a novel technique for online safety verification of autonomous systems, which performs reachability analysis efficiently for both bounded and unbounded horizons by employing neural barrier certificates.
no code implementations • 15 Mar 2024 • Oliver Schön, Zhengang Zhong, Sadegh Soudjani
Algorithmic verification of realistic systems to satisfy safety and other temporal requirements has suffered from poor scalability of the employed formal approaches.
no code implementations • 8 Mar 2024 • Zhi Zhang, Chenyu Ma, Saleh Soudijani, Sadegh Soudjani
A novel data-driven method for formal verification is proposed to study complex systems operating in safety-critical domains.
no code implementations • 15 Dec 2023 • Milad Kazemi, Mateo Perez, Fabio Somenzi, Sadegh Soudjani, Ashutosh Trivedi, Alvaro Velasquez
We present a modular approach to \emph{reinforcement learning} (RL) in environments consisting of simpler components evolving in parallel.
no code implementations • 25 Oct 2023 • Andrea Calvagna, Arabinda Ghosh, Sadegh Soudjani
We present a method, which incorporates knowledge awareness into the symbolic computation of discrete controllers for reactive cyber physical systems, to improve decision making about the unknown operating environment under uncertain/incomplete inputs.
no code implementations • 4 Oct 2023 • Shahram Yadollahi, Hamed Kebriaei, Sadegh Soudjani
In this paper, we focus on modeling and analysis of demand-side management in a microgrid where agents utilize grid energy and a shared battery charged by renewable energy sources.
no code implementations • 11 Sep 2023 • Omid Akbarzadeh, Sadegh Soudjani, Abolfazl Lavaei
This work is concerned with a formal approach for safety controller synthesis of stochastic control systems with both process and measurement noises while considering wireless communication networks between sensors, controllers, and actuators.
no code implementations • 3 Sep 2023 • Oliver Schön, Birgit van Huijgevoort, Sofie Haesaert, Sadegh Soudjani
We address two limitations of existing approaches for formal synthesis of controllers for networks of uncertain systems satisfying complex temporal specifications.
1 code implementation • 7 Jul 2023 • Rupak Majumdar, Mahmoud Salamati, Sadegh Soudjani
For the selected benchmarks, our approach reduces the memory requirements respectively for the synthesis and deployment by a factor of $1. 31\times 10^5$ and $7. 13\times 10^3$ on average, and up to $7. 54\times 10^5$ and $3. 18\times 10^4$.
no code implementations • 14 Apr 2023 • Oliver Schön, Birgit van Huijgevoort, Sofie Haesaert, Sadegh Soudjani
With a focus on continuous-space stochastic systems with parametric uncertainty, we propose a two-stage approach that decomposes the problem into a learning stage and a robust formal controller synthesis stage.
no code implementations • 23 Feb 2023 • Birgit van Huijgevoort, Oliver Schön, Sadegh Soudjani, Sofie Haesaert
We present SySCoRe, a MATLAB toolbox that synthesizes controllers for stochastic continuous-state systems to satisfy temporal logic specifications.
no code implementations • 15 Oct 2022 • Oliver Schön, Birgit van Huijgevoort, Sofie Haesaert, Sadegh Soudjani
We develop new methods for models of systems subject to both stochastic and parametric uncertainties.
no code implementations • 6 Aug 2022 • Abolfazl Lavaei, Mateo Perez, Milad Kazemi, Fabio Somenzi, Sadegh Soudjani, Ashutosh Trivedi, Majid Zamani
A key contribution is to leverage the convergence results for adversarial RL (minimax Q-learning) on finite stochastic arenas to provide control strategies maximizing the probability of satisfaction over the network of continuous-space systems.
no code implementations • 6 Aug 2022 • Abolfazl Lavaei, Sadegh Soudjani, Emilio Frazzoli
In our proposed scheme, we first provide an augmented framework to characterize each stochastic hybrid system containing continuous evolutions and instantaneous jumps with a unified system covering both scenarios.
no code implementations • 29 Jun 2022 • Abolfazl Lavaei, Sadegh Soudjani, Emilio Frazzoli, Majid Zamani
We then propose a scenario convex program (SCP) associated to the original RCP by collecting a finite number of data from trajectories of the system.
no code implementations • 16 Jun 2022 • Milad Kazemi, Rupak Majumdar, Mahmoud Salamati, Sadegh Soudjani, Ben Wooding
The growth bound together with the sampled trajectories are then used to construct the abstraction and synthesise a controller.
no code implementations • 23 Dec 2021 • Ali Salamati, Abolfazl Lavaei, Sadegh Soudjani, Majid Zamani
In this paper, we propose a data-driven approach to formally verify the safety of (potentially) unknown discrete-time continuous-space stochastic systems.
no code implementations • 19 Nov 2021 • Ali Salamati, Abolfazl Lavaei, Sadegh Soudjani, Majid Zamani
In this work, we study verification and synthesis problems for safety specifications over unknown discrete-time stochastic systems.
no code implementations • 4 Jan 2021 • Rupak Majumdar, Kaushik Mallik, Anne-Kathrin Schmuck, Sadegh Soudjani
While characterizing the exact satisfaction probability is open, we show that a lower bound on this probability can be obtained by (I) computing an under-approximation of the qualitative winning region, i. e., states from which the parity condition can be enforced almost surely, and (II) computing the maximal probability of reaching this qualitative winning region.
no code implementations • 14 Dec 2020 • Ameneh Nejati, Sadegh Soudjani, Majid Zamani
In this work, we propose a compositional framework for the construction of control barrier functions for networks of continuous-time stochastic hybrid systems enforcing complex logic specifications expressed by finite-state automata.
no code implementations • 8 May 2020 • Ali Salamati, Sadegh Soudjani, Majid Zamani
Since the dynamics are parameterized and partially unknown, we collect data from the system and employ Bayesian inference techniques to associate a confidence value to the satisfaction of the property.
no code implementations • 4 May 2020 • Milad Kazemi, Sadegh Soudjani
We use this procedure to guide the RL algorithm towards a policy that converges to an optimal policy under suitable assumptions on the process.
no code implementations • 2 Mar 2020 • Abolfazl Lavaei, Fabio Somenzi, Sadegh Soudjani, Ashutosh Trivedi, Majid Zamani
A key contribution of the paper is to leverage the classical convergence results for reinforcement learning on finite MDPs and provide control strategies maximizing the probability of satisfaction over unknown, continuous-space MDPs while providing probabilistic closeness guarantees.
no code implementations • 21 Jan 2019 • Mahmoud Salamati, Sadegh Soudjani, Rupak Majumdar
We run CMA-ES using human participants to provide the fitness function, using the insight that the choice of best candidates in CMA-ES can be naturally modeled as a perception task: pick the top $k$ inputs perceptually closest to a fixed input.