Scaling Federated Learning for Fine-tuning of Large Language Models

no code implementations • 1 Feb 2021 • Agrin Hilmkil, Sebastian Callh, Matteo Barbieri, Leon René Sütfeld, Edvin Listo Zec, Olof Mogren

We perform an extensive sweep over the number of clients, ranging up to 32, to evaluate the impact of distributed compute on task performance in the federated averaging setting.

Federated Learning Sentiment Analysis +2