The Unintended Consequences of Discount Regularization: Improving Regularization in Certainty Equivalence Reinforcement Learning

no code implementations • 20 Jun 2023 • Sarah Rathnam, Sonali Parbhoo, Weiwei Pan, Susan A. Murphy, Finale Doshi-Velez

We demonstrate that planning under a lower discount factor produces an identical optimal policy to planning using any prior on the transition matrix that has the same distribution for all states and actions.

Comparison and Unification of Three Regularization Methods in Batch Reinforcement Learning

no code implementations • 16 Sep 2021 • Sarah Rathnam, Susan A. Murphy, Finale Doshi-Velez

In batch reinforcement learning, there can be poorly explored state-action pairs resulting in poorly learned, inaccurate models and poorly performing associated policies.

reinforcement-learning Reinforcement Learning (RL)