1 code implementation • 18 Jun 2024 • Viktor Moskvoretskii, Nazarii Tupitsa, Chris Biemann, Samuel Horváth, Eduard Gorbunov, Irina Nikishina
We present a new approach based on the Personalized Federated Learning algorithm MeritFed that can be applied to Natural Language Tasks with heterogeneous data.
1 code implementation • 5 Mar 2024 • Sayantan Choudhury, Nazarii Tupitsa, Nicolas Loizou, Samuel Horvath, Martin Takac, Eduard Gorbunov
Adaptive methods are extremely popular in machine learning as they make learning rate tuning less expensive.
no code implementations • 7 Feb 2024 • Nazarii Tupitsa, Samuel Horváth, Martin Takáč, Eduard Gorbunov
In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges.
no code implementations • 9 Jun 2019 • Sergey Guminov, Pavel Dvurechensky, Nazarii Tupitsa, Alexander Gasnikov
In this paper we combine AM and Nesterov's acceleration to propose an accelerated alternating minimization algorithm.