Search Results for author:
Found 11 papers, 1 papers with code
Sample Complexity of Offline Distributionally Robust Linear Markov Decision Processes
In offline reinforcement learning (RL), the absence of active exploration calls for attention on the model robustness to tackle the sim-to-real gap, where the discrepancy between the simulated and deployed environments can significantly undermine the performance of the learned policy.
Federated Offline Reinforcement Learning: Collaborative Single-Policy Coverage Suffices
Our sample complexity analysis reveals that, with appropriately chosen parameters and synchronization schedules, FedLCB-Q achieves linear speedup in terms of the number of agents without requiring high-quality datasets at individual agents, as long as the local datasets collectively cover the state-action space visited by the optimal policy, highlighting the power of collaboration in the federated setting.
Offline Reinforcement Learning with On-Policy Q-Function Regularization
In this work, we propose to regularize towards the Q-function of the behavior policy instead of the behavior policy itself, under the premise that the Q-function can be estimated more reliably and easily by a SARSA-style estimate and handles the extrapolation error more straightforwardly.
The Curious Price of Distributional Robustness in Reinforcement Learning with a Generative Model
Assuming access to a generative model that draws samples based on the nominal MDP, we characterize the sample complexity of RMDPs when the uncertainty set is specified via either the total variation (TV) distance or $\chi^2$ divergence.
Curriculum Reinforcement Learning using Optimal Transport via Gradual Domain Adaptation
Curriculum Reinforcement Learning (CRL) aims to create a sequence of tasks, starting from easy ones and gradually learning towards difficult tasks.
Distributionally Robust Model-Based Offline Reinforcement Learning with Near-Optimal Sample Complexity
This paper concerns the central issues of model robustness and sample efficiency in offline reinforcement learning (RL), which aims to learn to perform decision making from history data without active exploration.
Settling the Sample Complexity of Model-Based Offline Reinforcement Learning
We demonstrate that the model-based (or "plug-in") approach achieves minimax-optimal sample complexity without burn-in cost for tabular Markov decision processes (MDPs).
Pessimistic Q-Learning for Offline Reinforcement Learning: Towards Optimal Sample Complexity
Offline or batch reinforcement learning seeks to learn a near-optimal policy using history data without active exploration of the environment.
Breaking the Sample Complexity Barrier to Regret-Optimal Model-Free Reinforcement Learning
Achieving sample efficiency in online episodic reinforcement learning (RL) requires optimally balancing exploration and exploitation.
Manifold Gradient Descent Solves Multi-Channel Sparse Blind Deconvolution Provably and Efficiently
Multi-channel sparse blind deconvolution, or convolutional sparse coding, refers to the problem of learning an unknown filter by observing its circulant convolutions with multiple input signals that are sparse.
Micro Hand Gesture Recognition System Using Ultrasonic Active Sensing
In this paper, we propose a micro hand gesture recognition system and methods using ultrasonic active sensing.
