Search Results for author: Petr Novotný

Found 5 papers, 1 papers with code

Efficient Strategy Synthesis for MDPs with Resource Constraints

no code implementations5 May 2021 František Blahoudek, Petr Novotný, Melkior Ornik, Pranay Thangeda, Ufuk Topcu

We consider qualitative strategy synthesis for the formalism called consumption Markov decision processes.

On the Complexity of Value Iteration

no code implementations13 Jul 2018 Nikhil Balaji, Stefan Kiefer, Petr Novotný, Guillermo A. Pérez, Mahsa Shirmohammadi

We show that, given a horizon $n$ in binary and an MDP, computing an optimal policy is EXP-complete, thus resolving an open problem that goes back to the seminal 1987 paper on the complexity of MDPs by Papadimitriou and Tsitsiklis.

Expectation Optimization with Probabilistic Guarantees in POMDPs with Discounted-sum Objectives

no code implementations27 Apr 2018 Krishnendu Chatterjee, Adrián Elgyütt, Petr Novotný, Owen Rouillé

We consider the expectation optimization with probabilistic guarantee (EOPG) problem, where the goal is to optimize the expectation ensuring that the payoff is above a given threshold with at least a specified probability.

Decision Making Decision Making Under Uncertainty

Optimizing Expectation with Guarantees in POMDPs (Technical Report)

1 code implementation26 Nov 2016 Krishnendu Chatterjee, Petr Novotný, Guillermo A. Pérez, Jean-François Raskin, Đorđe Žikelić

In this work we go beyond both the "expectation" and "threshold" approaches and consider a "guaranteed payoff optimization (GPO)" problem for POMDPs, where we are given a threshold $t$ and the objective is to find a policy $\sigma$ such that a) each possible outcome of $\sigma$ yields a discounted-sum payoff of at least $t$, and b) the expected discounted-sum payoff of $\sigma$ is optimal (or near-optimal) among all policies satisfying a).

Stochastic Shortest Path with Energy Constraints in POMDPs

no code implementations24 Feb 2016 Tomáš Brázdil, Krishnendu Chatterjee, Martin Chmelík, Anchit Gupta, Petr Novotný

Finally, we show experimentally that our algorithm performs well and computes succinct policies on a number of POMDP instances from the literature that were naturally enhanced with energy levels.

Cannot find the paper you are looking for? You can Submit a new open access paper.