Decentralized Word2Vec Using Gossip Learning

no code implementations • NoDaLiDa 2021 • Abdul Aziz Alkathiri, Lodovico Giaretta, Sarunas Girdzijauskas, Magnus Sahlgren

Advanced NLP models require huge amounts of data from various domains to produce high-quality representations.

Federated Word2Vec: Leveraging Federated Learning to Encourage Collaborative Representation Learning

no code implementations • 19 Apr 2021 • Daniel Garcia Bernal, Lodovico Giaretta, Sarunas Girdzijauskas, Magnus Sahlgren

The results show that neither the quality of the results nor the convergence time in Federated Word2Vec deteriorates as compared to centralised Word2Vec.

Federated Learning Representation Learning