no code implementations • 29 Oct 2024 • Shaan ul Haque, Siva Theja Maguluri
Recent works studied this problem in the actor-critic framework and established finite sample bounds assuming access to a critic with certain error guarantees.
no code implementations • 31 Dec 2023 • Shaan ul Haque, Sajad Khodadadian, Siva Theja Maguluri
SA appears in many areas such as optimization and Reinforcement Learning (RL).
no code implementations • 7 Jun 2022 • Shaan ul Haque, Vivek Borkar
We derive a concentration bound for a Q-learning algorithm for average cost Markov decision processes based on an equivalent shortest path problem, and compare it numerically with the alternative scheme based on relative value iteration.
no code implementations • 3 Mar 2022 • Shaan ul Haque, Ajit Rajwade, Karthik S. Gurumoorthy
We create a dictionary of various families of distributions by inspecting the data, and use it to approximate each decomposed factor of the product in the mixture.