Search Results for author: Calin Belta

Found 33 papers, 4 papers with code

Compositional Synthesis for Linear Systems via Convex Optimization of Assume-Guarantee Contracts

no code implementations2 Aug 2022 Kasra Ghasemi, Sadra Sadraddini, Calin Belta

We take a divide and conquer approach to design controllers for reachability problems given large-scale linear systems with polyhedral constraints on states, controls, and disturbances.

Decentralized Signal Temporal Logic Control for Perturbed Interconnected Systems via Assume-Guarantee Contract Optimization

no code implementations30 Jun 2022 Kasra Ghasemi, Sadra Sadraddini, Calin Belta

We develop a novel decentralized control method for a network of perturbed linear systems with dynamical couplings subject to Signal Temporal Logic (STL) specifications.

Distributed Control using Reinforcement Learning with Temporal-Logic-Based Reward Shaping

no code implementations8 Mar 2022 Ningyuan Zhang, Wenliang Liu, Calin Belta

We present a computational framework for synthesis of distributed control strategies for a heterogeneous team of robots in a partially observable environment.

reinforcement-learning

High Order Robust Adaptive Control Barrier Functions and Exponentially Stabilizing Adaptive Control Lyapunov Functions

no code implementations3 Mar 2022 Max H. Cohen, Calin Belta

We first introduce the notion of a High Order Robust Adaptive Control Barrier Function (HO-RaCBF) as a means to compute control policies guaranteeing satisfaction of high relative degree safety constraints in the face of parametric model uncertainty.

Overcoming Exploration: Deep Reinforcement Learning in Complex Environments from Temporal Logic Specifications

no code implementations28 Jan 2022 Mingyu Cai, Erfan Aasi, Calin Belta, Cristian-Ioan Vasile

We present a Deep Reinforcement Learning (DRL) algorithm for a task-guided robot with unknown continuous-time dynamics deployed in a large-scale complex environment.

reinforcement-learning

Time-Incremental Learning from Data Using Temporal Logics

no code implementations28 Dec 2021 Erfan Aasi, Mingyu Cai, Cristian Ioan Vasile, Calin Belta

In this paper, we introduce a time-incremental learning framework: given a dataset of labeled signal traces with a common time horizon, we propose a method to predict the label of a signal that is received incrementally over time, referred to as prefix signal.

Decision Making Incremental Learning +1

Learning Spatio-Temporal Specifications for Dynamical Systems

no code implementations20 Dec 2021 Suhail Alsalehi, Erfan Aasi, Ron Weiss, Calin Belta

In addition, given system requirements in the form of SVM-STL specifications, we provide an approach for parameter synthesis to find parameters that maximize the satisfaction of such specifications.

Formal Logic

Classification of Time-Series Data Using Boosted Decision Trees

1 code implementation1 Oct 2021 Erfan Aasi, Cristian Ioan Vasile, Mahroo Bahreinian, Calin Belta

Our algorithm leverages an ensemble of Concise Decision Trees (CDTs) to improve the classification performance, where each CDT is a decision tree that is empowered by a set of techniques to generate simpler formulae and improve interpretability.

Autonomous Driving Classification +2

Inferring Temporal Logic Properties from Data using Boosted Decision Trees

no code implementations24 May 2021 Erfan Aasi, Cristian Ioan Vasile, Mahroo Bahreinian, Calin Belta

Many autonomous systems, such as robots and self-driving cars, involve real-time decision making in complex environments, and require prediction of future outcomes from limited data.

Autonomous Driving Decision Making +2

Safe Exploration in Model-based Reinforcement Learning using Control Barrier Functions

no code implementations16 Apr 2021 Max H. Cohen, Calin Belta

This paper develops a model based reinforcement learning (MBRL) framework for learning online the value function of an infinite-horizon optimal control problem while obeying safety constraints expressed as control barrier functions (CBFs).

Model-based Reinforcement Learning reinforcement-learning +1

Neural Network-based Control for Multi-Agent Systems from Spatio-Temporal Specifications

no code implementations6 Apr 2021 Suhail Alsalehi, Noushin Mehdipour, Ezio Bartocci, Calin Belta

We propose a framework for solving control synthesis problems for multi-agent networked systems required to satisfy spatio-temporal specifications.

Model-Based Safe Policy Search from Signal Temporal Logic Specifications Using Recurrent Neural Networks

no code implementations29 Mar 2021 Wenliang Liu, Mirai Nishioka, Calin Belta

To capture the history dependency of STL specifications, we use a recurrent neural network (RNN) to implement the control policy.

Event-Triggered Safety-Critical Control for Systems with Unknown Dynamics

no code implementations29 Mar 2021 Wei Xiao, Calin Belta, Christos G. Cassandras

We define a HOCBF for a safety requirement on the unmodelled system based on the adaptive dynamics and error states, and reformulate the safety-critical control problem as the above mentioned QP.

Experimental Validation of Linear and Nonlinear MPC on an Articulated Unmanned Ground Vehicle

no code implementations25 Mar 2021 Erkan Kayacan, Wouter Saeys, Herman Ramon, Calin Belta, Joshua M. Peschel

The experimental results for a time-based trajectory show that the NMHE-NMPC framework with the proposed real-time iteration scheme gives better trajectory tracking performance than the ISL-LMPC framework and the required computation time is feasible for real-time applications.

Model-Based Reinforcement Learning for Approximate Optimal Control with Temporal Logic Specifications

no code implementations18 Jan 2021 Max Cohen, Calin Belta

In this paper we study the problem of synthesizing optimal control policies for uncertain continuous-time nonlinear systems from syntactically co-safe linear temporal logic (scLTL) formulas.

Model-based Reinforcement Learning reinforcement-learning

Rule-based Optimal Control for Autonomous Driving

no code implementations14 Jan 2021 Wei Xiao, Noushin Mehdipour, Anne Collin, Amitai Bin-Nun, Emilio Frazzoli, Radboud Duintjer Tebbens, Calin Belta

We develop optimal control strategies for Autonomous Vehicles (AVs) that are required to meet complex specifications imposed by traffic laws and cultural expectations of reasonable driving behavior.

Autonomous Driving Robotics Systems and Control Systems and Control

Recurrent Neural Network Controllers for Signal Temporal Logic Specifications Subject to Safety Constraints

no code implementations24 Sep 2020 Wenliang Liu, Noushin Mehdipour, Calin Belta

We propose a framework based on Recurrent Neural Networks (RNNs) to determine an optimal control strategy for a discrete-time system that is required to satisfy specifications given as Signal Temporal Logic (STL) formulae.

How Retroactivity Affects the Behavior of Incoherent Feed-Forward Loops

no code implementations15 Jul 2020 Junmin Wang, Calin Belta, Samuel A. Isaacson

We compare the behaviors of IFFLs to negative autoregulatory loops, another sign-sensitive response-accelerating network motif, and find that increasing retroactivity in a negative autoregulated circuit can only slow the response.

Distributed and Consistent Multi-Image Feature Matching via QuickMatch

no code implementations29 Oct 2019 Zachary Serlin, Guang Yang, Brandon Sookraj, Calin Belta, Roberto Tron

The centralized QuickMatch algorithm is compared to other standard matching algorithms, while the Distributed QuickMatch algorithm is compared to the centralized algorithm in terms of preservation of match consistency.

object-detection Object Detection +1

Automata Guided Skill Composition

no code implementations ICLR 2019 Xiao Li, Yao Ma, Calin Belta

Skills learned through (deep) reinforcement learning often generalizes poorly across tasks and re-training is necessary when presented with a new task.

reinforcement-learning

Control from Signal Temporal Logic Specifications with Smooth Cumulative Quantitative Semantics

1 code implementation25 Apr 2019 Iman Haghighi, Noushin Mehdipour, Ezio Bartocci, Calin Belta

We present a framework to synthesize control policies for nonlinear dynamical systems from complex temporal constraints specified in a rich temporal logic called Signal Temporal Logic (STL).

Systems and Control

Automata Guided Reinforcement Learning With Demonstrations

no code implementations17 Sep 2018 Xiao Li, Yao Ma, Calin Belta

Tasks with complex temporal structures and long horizons pose a challenge for reinforcement learning agents due to the difficulty in specifying the tasks in terms of reward functions as well as large variances in the learning signals.

reinforcement-learning

AUTOMATA GUIDED HIERARCHICAL REINFORCEMENT LEARNING FOR ZERO-SHOT SKILL COMPOSITION

no code implementations ICLR 2018 Xiao Li, Yao Ma, Calin Belta

An obstacle that prevents the wide adoption of (deep) reinforcement learning (RL) in control systems is its need for a large number of interactions with the environment in order to master a skill.

Hierarchical Reinforcement Learning reinforcement-learning

Automata-Guided Hierarchical Reinforcement Learning for Skill Composition

no code implementations31 Oct 2017 Xiao Li, Yao Ma, Calin Belta

Skills learned through (deep) reinforcement learning often generalizes poorly across domains and re-training is necessary when presented with a new task.

Hierarchical Reinforcement Learning reinforcement-learning

A Policy Search Method For Temporal Logic Specified Reinforcement Learning Tasks

no code implementations27 Sep 2017 Xiao Li, Yao Ma, Calin Belta

In this paper, we explore the use of temporal logic (TL) to specify tasks in reinforcement learning.

reinforcement-learning

Reinforcement Learning With Temporal Logic Rewards

no code implementations11 Dec 2016 Xiao Li, Cristian-Ioan Vasile, Calin Belta

We propose Truncated Linear Temporal Logic (TLTL) as specifications language, that is arguably well suited for the robotics applications, together with quantitative semantics, i. e., robustness degree.

reinforcement-learning

Q-Learning for Robust Satisfaction of Signal Temporal Logic Specifications

no code implementations23 Sep 2016 Derya Aksaray, Austin Jones, Zhaodan Kong, Mac Schwager, Calin Belta

This paper addresses the problem of learning optimal policies for satisfying signal temporal logic (STL) specifications by agents with unknown stochastic dynamics.

Systems and Control

A Hierarchical Reinforcement Learning Method for Persistent Time-Sensitive Tasks

no code implementations20 Jun 2016 Xiao Li, Calin Belta

Reinforcement learning has been applied to many interesting problems such as the famous TD-gammon and the inverted helicopter flight.

Hierarchical Reinforcement Learning reinforcement-learning

Time Window Temporal Logic

2 code implementations13 Feb 2016 Cristian-Ioan Vasile, Derya Aksaray, Calin Belta

This paper introduces time window temporal logic (TWTL), a rich expressivity language for describing various time bounded specifications.

Formal Languages and Automata Theory Logic in Computer Science

A Formal Methods Approach to Pattern Synthesis in Reaction Diffusion Systems

no code implementations12 Sep 2014 Ebru Aydin Gol, Ezio Bartocci, Calin Belta

We propose a technique to detect and generate patterns in a network of locally interacting dynamical systems.

Technical Report: Distribution Temporal Logic: Combining Correctness with Quality of Estimation

no code implementations9 Sep 2013 Austin Jones, Mac Schwager, Calin Belta

We present a new temporal logic called Distribution Temporal Logic (DTL) defined over predicates of belief states and hidden states of partially observable systems.

Cannot find the paper you are looking for? You can Submit a new open access paper.