# Almost Horizon-Free Structure-Aware Best Policy Identification with a Generative Model

Andrea ZanetteMykel J. KochenderferEmma Brunskill

This paper focuses on the problem of computing an $\epsilon$-optimal policy in a discounted Markov Decision Process (MDP) provided that we can access the reward and transition function through a generative model. We propose an algorithm that is initially agnostic to the MDP but that can leverage the specific MDP structure, expressed in terms of variances of the rewards and next-state value function, and gaps in the optimal action-value function to reduce the sample complexity needed to find a good policy, precisely highlighting the contribution of each state-action pair to the final sample complexity... (read more)

PDF Abstract

No code implementations yet. Submit your code now