no code implementations • 26 Jul 2024 • Swetha Ganesh, Washim Uddin Mondal, Vaneet Aggarwal
This work analyzes average-reward reinforcement learning with general parametrization.
no code implementations • 2 Apr 2024 • Swetha Ganesh, Washim Uddin Mondal, Vaneet Aggarwal
The second approach, rooted in Hessian-based techniques, ensures an expected regret of the order $\tilde{\mathcal{O}}(\sqrt{T})$.
no code implementations • 15 Mar 2024 • Swetha Ganesh, Jiayu Chen, Gugan Thoppe, Vaneet Aggarwal
Federated Reinforcement Learning (FRL) allows multiple agents to collaboratively build a decision making policy without sharing raw trajectories.
no code implementations • 4 Apr 2023 • Swetha Ganesh, Alexandre Reiffers-Masson, Gugan Thoppe
Our main result is that the proposed algorithm almost surely converges to the desired mean $\mu.$ This makes ours the first asynchronous FL method to have an a. s. convergence guarantee in the presence of adversaries.
no code implementations • 29 Oct 2021 • Swetha Ganesh, Rohan Deb, Gugan Thoppe, Amarjit Budhiraja
Stochastic Heavy Ball (SHB) and Nesterov's Accelerated Stochastic Gradient (ASG) are popular momentum methods in stochastic optimization.