Search Results for author:
Found 1 papers, 0 papers with code
Learn Your Reference Model for Real Good Alignment
For instance, in the fundamental Reinforcement Learning From Human Feedback (RLHF) technique of Language Model alignment, in addition to reward maximization, the Kullback-Leibler divergence between the trainable policy and the SFT policy is minimized.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
