no code implementations • 17 Jun 2024 • Aneesh Pappu, Billy Porter, Ilia Shumailov, Jamie Hayes
Understanding this relationship is important as real user data may be collected and used to align large models; if user data is memorized during RLHF and later regurgitated, this could raise privacy concerns.