Search Results for author: Pierluigi Nuzzo

Found 14 papers, 0 papers with code

Sparse but Strong: Crafting Adversarially Robust Graph Lottery Tickets

no code implementations11 Dec 2023 Subhajit Dutta Chowdhury, Zhiyu Ni, Qingyuan Peng, Souvik Kundu, Pierluigi Nuzzo

By iteratively applying ARGS to prune both the perturbed graph adjacency matrix and the GNN model weights, we can find adversarially robust graph lottery tickets that are highly sparse yet achieve competitive performance under different untargeted training-time structure attacks.

Regret Analysis of the Posterior Sampling-based Learning Algorithm for Episodic POMDPs

no code implementations16 Oct 2023 Dengwang Tang, Rahul Jain, Ashutosh Nayyar, Pierluigi Nuzzo

We propose a Posterior Sampling-based reinforcement learning algorithm for POMDPs (PS4POMDPs), which is much simpler and more implementable compared to state-of-the-art optimism-based online learning algorithms for POMDPs.

Optimal Control of Logically Constrained Partially Observable and Multi-Agent Markov Decision Processes

no code implementations24 May 2023 Krishna C. Kalagarla, Dhruva Kartik, Dongming Shen, Rahul Jain, Ashutosh Nayyar, Pierluigi Nuzzo

In this paper, we first introduce an optimal control theory for partially observable Markov decision processes (POMDPs) with finite linear temporal logic constraints.

Exact and Cost-Effective Automated Transformation of Neural Network Controllers to Decision Tree Controllers

no code implementations11 Apr 2023 Kevin Chang, Nathan Dahlin, Rahul Jain, Pierluigi Nuzzo

Over the past decade, neural network (NN)-based controllers have demonstrated remarkable efficacy in a variety of decision-making tasks.

Decision Making OpenAI Gym

Co-Design of Topology, Scheduling, and Path Planning in Automated Warehouses

no code implementations2 Mar 2023 Christopher Leet, Chanwook Oh, Michele Lora, Sven Koenig, Pierluigi Nuzzo

Given a list of products, the WSP amounts to finding a plan for a team of agents which brings every product on the list to a station within a given timeframe.

Scheduling

Safe Posterior Sampling for Constrained MDPs with Bounded Constraint Violation

no code implementations27 Jan 2023 Krishna C Kalagarla, Rahul Jain, Pierluigi Nuzzo

Constrained Markov decision processes (CMDPs) model scenarios of sequential decision making with multiple objectives that are increasingly important in many applications.

Decision Making

Control Barrier Function Contracts for Vehicular Mission Planning Under Signal Temporal Logic Specifications

no code implementations15 Sep 2022 Muhammad Waqas, Nikhil Vijay Naik, Petros Ioannou, Pierluigi Nuzzo

The STL predicates are then mapped to an aggregation of contracts associated with continuously differentiable time-varying control barrier functions.

Correct-By-Construction Design of Adaptive Cruise Control with Control Barrier Functions Under Safety and Regulatory Constraints

no code implementations26 Mar 2022 Muhammad Waqas, Muhammad Ali Murtaza, Pierluigi Nuzzo, Petros Ioannou

The safety-critical nature of adaptive cruise control (ACC) systems calls for systematic design procedures, e. g., based on formal methods or control barrier functions (CBFs), to provide strong guarantees of safety and performance under all driving conditions.

ReIGNN: State Register Identification Using Graph Neural Networks for Circuit Reverse Engineering

no code implementations1 Dec 2021 Subhajit Dutta Chowdhury, Kaixin Yang, Pierluigi Nuzzo

Reverse engineering an integrated circuit netlist is a powerful tool to help detect malicious logic and counteract design piracy.

Model-Free Reinforcement Learning for Optimal Control of MarkovDecision Processes Under Signal Temporal Logic Specifications

no code implementations27 Sep 2021 Krishna C. Kalagarla, Rahul Jain, Pierluigi Nuzzo

We present a model-free reinforcement learning algorithm to find an optimal policy for a finite-horizon Markov decision process while guaranteeing a desired lower bound on the probability of satisfying a signal temporal logic (STL) specification.

Motion Planning reinforcement-learning +1

Synthesis of Discounted-Reward Optimal Policies for Markov Decision Processes Under Linear Temporal Logic Specifications

no code implementations1 Nov 2020 Krishna C. Kalagarla, Rahul Jain, Pierluigi Nuzzo

We present a method to find an optimal policy with respect to a reward function for a discounted Markov decision process under general linear temporal logic (LTL) specifications.

Motion Planning

A Sample-Efficient Algorithm for Episodic Finite-Horizon MDP with Constraints

no code implementations23 Sep 2020 Krishna C. Kalagarla, Rahul Jain, Pierluigi Nuzzo

Constrained Markov Decision Processes (CMDPs) formalize sequential decision-making problems whose objective is to minimize a cost function while satisfying constraints on various cost functions.

Decision Making

Cannot find the paper you are looking for? You can Submit a new open access paper.