Understanding Unintended Memorization in Language Models Under Federated Learning

no code implementations • NAACL (PrivateNLP) 2021 • Om Dipakbhai Thakkar, Swaroop Ramaswamy, Rajiv Mathews, Francoise Beaufays

Thus, we initiate a formal study to understand the effect of different components of FL on unintended memorization in trained NWP models.

Federated Learning Memorization

Model-Agnostic Private Learning

no code implementations • NeurIPS 2018 • Raef Bassily, Abhradeep Guha Thakurta, Om Dipakbhai Thakkar

In the PAC model, we analyze our construction and prove upper bounds on the sample complexity for both the realizable and the non-realizable cases.

General Classification Transfer Learning