Search Results for author:
Found 15 papers, 3 papers with code
Task-Agnostic Exploration via Policy Gradient of a Non-Parametric State Entropy Estimate
In a reward-free environment, what is a suitable intrinsic objective for an agent to pursue so that it can learn an optimal task-agnostic exploration policy?
A Policy Gradient Method for Task-Agnostic Exploration
In a reward-free environment, what is a suitable intrinsic objective for an agent to pursue so that it can learn an optimal task-agnostic exploration policy?
Unsupervised Reinforcement Learning in Multiple Environments
Along this line, we address the problem of unsupervised reinforcement learning in a class of multiple environments, in which the policy is pre-trained with interactions from the whole class, and then fine-tuned for several tasks in any environment of the class.
Configurable Markov Decision Processes
After having introduced our approach and derived some theoretical results, we present the experimental evaluation in two explicative problems to show the benefits of the environment configurability on the performance of the learned policy.
An Intrinsically-Motivated Approach for Learning Highly Exploring and Fast Mixing Policies
What is a good exploration strategy for an agent that interacts with an environment in the absence of external rewards?
Learning to Explore a Class of Multiple Reward-Free Environments
Along this line, we address the problem of learning to explore a class of multiple reward-free environments with a unique general strategy, which aims to provide a universal initialization to subsequent reinforcement learning problems specified over the same class.
Learning to Explore Multiple Environments without Rewards
Along this line, we address the problem of learning to explore a class of multiple reward-free environments with a unique general strategy, which aims to provide a universal initialization to subsequent reinforcement learning problems specified over the same class.
Challenging Common Assumptions in Convex Reinforcement Learning
In particular, we show that erroneously optimizing the infinite trials objective in place of the actual finite trials one, as it is usually done, can lead to a significant approximation error.
The Importance of Non-Markovianity in Maximum State Entropy Exploration
In the maximum state entropy exploration framework, an agent interacts with a reward-free environment to learn a policy that maximizes the entropy of the expected state visitations it is inducing.
Provably Efficient Causal Model-Based Reinforcement Learning for Systematic Generalization
In this setting, the agent can take a finite amount of reward-free interactions from a subset of these environments.
Reward-Free Policy Space Compression for Reinforcement Learning
In this paper, we seek for a reward-free compression of the policy space into a finite set of representative policies, such that, given any policy $\pi$, the minimum R\'enyi divergence between the state-action distributions of the representative policies and the state-action distribution of $\pi$ is bounded.
A Tale of Sampling and Estimation in Discounted Reinforcement Learning
In this paper, we present a minimax lower bound on the discounted mean estimation problem that explicitly connects the estimation error with the mixing properties of the Markov process and the discount factor.
Exploiting Causal Graph Priors with Posterior Sampling for Reinforcement Learning
The prior is typically specified as a class of parametric distributions, the design of which can be cumbersome in practice, often resulting in the choice of uninformative priors.
A Framework for Partially Observed Reward-States in RLHF
We show reductions from the the two dominant forms of human feedback in RLHF - cardinal and dueling feedback to PORRL.
Offline Inverse RL: New Solution Concepts and Provably Efficient Algorithms
In this paper, we introduce a novel notion of feasible reward set capturing the opportunities and limitations of the offline setting and we analyze the complexity of its estimation.
