Search Results for author: Guillermo A. Perez

Found 7 papers, 3 papers with code

Synthesizing Efficiently Monitorable Formulas in Metric Temporal Logic

no code implementations26 Oct 2023 Ritam Raha, Rajarshi Roy, Nathanael Fijalkow, Daniel Neider, Guillermo A. Perez

In runtime verification, manually formalizing a specification for monitoring system executions is a tedious and error-prone process.

COOL-MC: A Comprehensive Tool for Reinforcement Learning and Model Checking

3 code implementations15 Sep 2022 Dennis Gross, Nils Jansen, Sebastian Junges, Guillermo A. Perez

This paper presents COOL-MC, a tool that integrates state-of-the-art reinforcement learning (RL) and model checking.

OpenAI Gym reinforcement-learning +1

Lecture Notes on Partially Known MDPs

no code implementations6 Dec 2021 Guillermo A. Perez

In these notes we will tackle the problem of finding optimal policies for Markov decision processes (MDPs) which are not fully known to us.

reinforcement-learning Reinforcement Learning (RL)

Active Learning of Sequential Transducers with Side Information about the Domain

no code implementations23 Apr 2021 Raphaël Berthon, Adrien Boiret, Guillermo A. Perez, Jean-François Raskin

We show that there exists an algorithm using string equation solvers that uses this knowledge to learn subsequential string transducers with a better guarantee on the required number of equivalence queries than classical active learning.

Active Learning

The Extended HOA Format for Synthesis

5 code implementations12 Dec 2019 Guillermo A. Perez

We propose a small extension to the Hanoi Omega-Automata format to define reactive-synthesis problems.

Logic in Computer Science Formal Languages and Automata Theory

The Complexity of Graph-Based Reductions for Reachability in Markov Decision Processes

no code implementations22 Oct 2017 Stephane Le Roux, Guillermo A. Perez

We study the never-worse relation (NWR) for Markov decision processes with an infinite-horizon reachability objective.

Relation

Cannot find the paper you are looking for? You can Submit a new open access paper.