Search Results for author: Yashaswini Murthy

Found 5 papers, 0 papers with code

On the Global Convergence of Policy Gradient in Average Reward Markov Decision Processes

no code implementations11 Mar 2024 Navdeep Kumar, Yashaswini Murthy, Itai Shufaro, Kfir Y. Levy, R. Srikant, Shie Mannor

We present the first finite time global convergence analysis of policy gradient in the context of infinite horizon average reward Markov decision processes (MDPs).

On the Convergence of Modified Policy Iteration in Risk Sensitive Exponential Cost Markov Decision Processes

no code implementations8 Feb 2023 Yashaswini Murthy, Mehrdad Moharrami, R. Srikant

Since the exponential cost formulation deals with the multiplicative Bellman equation, our main contribution is a convergence proof which is quite different than existing results for discounted and risk-neutral average-cost problems as well as risk sensitive value and policy iteration approaches.

Computational Efficiency

A Policy Gradient Algorithm for the Risk-Sensitive Exponential Cost MDP

no code implementations8 Feb 2022 Mehrdad Moharrami, Yashaswini Murthy, Arghyadip Roy, R. Srikant

We study the risk-sensitive exponential cost MDP formulation and develop a trajectory-based gradient algorithm to find the stationary point of the cost associated with a set of parameterized policies.

Nonlinear Dynamics of Binocular Rivalry: A Comparative Study

no code implementations25 Nov 2018 Yashaswini Murthy

When our eyes are presented with the same image, the brain processes it to view it as a single coherent one.

Cannot find the paper you are looking for? You can Submit a new open access paper.