Search Results for author: Cyrus Neary

Found 14 papers, 7 papers with code

A Multifidelity Sim-to-Real Pipeline for Verifiable and Compositional Reinforcement Learning

no code implementations2 Dec 2023 Cyrus Neary, Christian Ellis, Aryaman Singh Samyal, Craig Lennon, Ufuk Topcu

We propose and demonstrate a compositional framework for training and verifying reinforcement learning (RL) systems within a multifidelity sim-to-real pipeline, in order to deploy reliable and adaptable RL policies on physical hardware.

reinforcement-learning Reinforcement Learning (RL)

Formal Methods for Autonomous Systems

no code implementations2 Nov 2023 Tichakorn Wongpiromsarn, Mahsa Ghasemi, Murat Cubuktepe, Georgios Bakirtzis, Steven Carr, Mustafa O. Karabag, Cyrus Neary, Parham Gohari, Ufuk Topcu

Formal methods refer to rigorous, mathematical approaches to system development and have played a key role in establishing the correctness of safety-critical systems.

Verifiable Reinforcement Learning Systems via Compositionality

no code implementations9 Sep 2023 Cyrus Neary, Aryaman Singh Samyal, Christos Verginis, Murat Cubuktepe, Ufuk Topcu

We propose a framework for verifiable and compositional reinforcement learning (RL) in which a collection of RL subsystems, each of which learns to accomplish a separate subtask, are composed to achieve an overall task.

reinforcement-learning Reinforcement Learning (RL)

Multimodal Pretrained Models for Sequential Decision-Making: Synthesis, Verification, Grounding, and Perception

no code implementations10 Aug 2023 Yunhao Yang, Cyrus Neary, Ufuk Topcu

We develop an algorithm that utilizes the knowledge from pretrained models to construct and verify controllers for sequential decision-making tasks, and to ground these controllers to task environments through visual observations.

Decision Making Robot Manipulation +1

How to Learn and Generalize From Three Minutes of Data: Physics-Constrained and Uncertainty-Aware Neural Stochastic Differential Equations

no code implementations10 Jun 2023 Franck Djeumou, Cyrus Neary, Ufuk Topcu

We present a framework and algorithms to learn controlled dynamics models using neural stochastic differential equations (SDEs) -- SDEs whose drift and diffusion terms are both parametrized by neural networks.

Inductive Bias Model-based Reinforcement Learning +1

Differential Privacy in Cooperative Multiagent Planning

1 code implementation20 Jan 2023 Bo Chen, Calvin Hawkins, Mustafa O. Karabag, Cyrus Neary, Matthew Hale, Ufuk Topcu

We synthesize policies that are robust to privacy by reducing the value of the total correlation.

Decision Making

Physics-Informed Kernel Embeddings: Integrating Prior System Knowledge with Data-Driven Control

no code implementations9 Jan 2023 Adam J. Thorpe, Cyrus Neary, Franck Djeumou, Meeko M. K. Oishi, Ufuk Topcu

Our proposed approach incorporates prior knowledge of the system dynamics as a bias term in the kernel learning problem.

Automaton-Based Representations of Task Knowledge from Generative Language Models

no code implementations4 Dec 2022 Yunhao Yang, Jean-Raphaël Gaglione, Cyrus Neary, Ufuk Topcu

However, the textual outputs from GLMs cannot be formally verified or used for sequential decision-making.

Decision Making

Compositional Learning of Dynamical System Models Using Port-Hamiltonian Neural Networks

1 code implementation1 Dec 2022 Cyrus Neary, Ufuk Topcu

Toward the objective of learning composite models of such systems from data, we present i) a framework for compositional neural networks, ii) algorithms to train these models, iii) a method to compose the learned models, iv) theoretical results that bound the error of the resulting composite models, and v) a method to learn the composition itself, when it is not known a priori.

Inductive Bias

Planning Not to Talk: Multiagent Systems that are Robust to Communication Loss

1 code implementation17 Jan 2022 Mustafa O. Karabag, Cyrus Neary, Ufuk Topcu

In this work, we develop joint policies for cooperative multiagent systems that are robust to potential losses in communication.

Taylor-Lagrange Neural Ordinary Differential Equations: Toward Fast Training and Evaluation of Neural ODEs

1 code implementation14 Jan 2022 Franck Djeumou, Cyrus Neary, Eric Goubault, Sylvie Putot, Ufuk Topcu

Neural ordinary differential equations (NODEs) -- parametrizations of differential equations using neural networks -- have shown tremendous promise in learning models of unknown continuous-time dynamical systems from data.

Density Estimation Image Classification +1

Neural Networks with Physics-Informed Architectures and Constraints for Dynamical Systems Modeling

1 code implementation14 Sep 2021 Franck Djeumou, Cyrus Neary, Eric Goubault, Sylvie Putot, Ufuk Topcu

The physics-informed constraints are enforced via the augmented Lagrangian method during the model's training.

Inductive Bias

Verifiable and Compositional Reinforcement Learning Systems

1 code implementation7 Jun 2021 Cyrus Neary, Christos Verginis, Murat Cubuktepe, Ufuk Topcu

We propose a framework for verifiable and compositional reinforcement learning (RL) in which a collection of RL subsystems, each of which learns to accomplish a separate subtask, are composed to achieve an overall task.

reinforcement-learning Reinforcement Learning (RL)

Reward Machines for Cooperative Multi-Agent Reinforcement Learning

2 code implementations3 Jul 2020 Cyrus Neary, Zhe Xu, Bo Wu, Ufuk Topcu

In cooperative multi-agent reinforcement learning, a collection of agents learns to interact in a shared environment to achieve a common goal.

Multi-agent Reinforcement Learning Q-Learning +2

Cannot find the paper you are looking for? You can Submit a new open access paper.