Search Results for author:
Found 4 papers, 1 papers with code
Learn Your Reference Model for Real Good Alignment
For instance, in the fundamental Reinforcement Learning From Human Feedback (RLHF) technique of Language Model alignment, in addition to reward maximization, the Kullback-Leibler divergence between the trainable policy and the SFT policy is minimized.
Linear Transformers with Learnable Kernel Functions are Better In-Context Models
Advancing the frontier of subquadratic architectures for Language Models (LMs) is crucial in the rapidly evolving field of natural language processing.
Reinforcement learning for question answering in programming domain using public community scoring as a human feedback
In this study, we investigate the enhancement of the GPT Neo 125M performance in Community Question Answering (CQA) with a focus on programming, through the integration of Reinforcement Learning from Human Feedback (RLHF) and the utilization of scores from Stack Overflow.
Bayesian Networks for Named Entity Prediction in Programming Community Question Answering
We also discuss the influence of penalty terms on the structure of Bayesian networks and how they can be used to analyze the relationships between entities.
