no code implementations • 29 Jan 2021 • Osman Ramadan, James Withers, Douglas Orr
It first transforms the counts to log space, approximating the distribution of the public and private data as Gaussian.
no code implementations • 14 Jan 2021 • Huseyin A. Inan, Osman Ramadan, Lukas Wutschitz, Daniel Jones, Victor Rühle, James Withers, Robert Sim
It has been demonstrated that strong performance of language models comes along with the ability to memorize rare training samples, which poses serious privacy threats in case the model is trained on confidential user content.