Privacy-Preserving Low-Rank Adaptation for Latent Diffusion Models

1 code implementation • 19 Feb 2024 • Zihao Luo, Xilie Xu, Feng Liu, Yun Sing Koh, Di Wang, Jingfeng Zhang

To mitigate this issue, we propose Stable PrivateLoRA that adapts the LDM by minimizing the ratio of the adaptation loss to the MI gain, which implicitly rescales the gradient and thus stabilizes the optimization.

Privacy Preserving