Search Results for author:
Found 3 papers, 1 papers with code
RewriteLM: An Instruction-Tuned Large Language Model for Text Rewriting
In this work, we develop new strategies for instruction tuning and reinforcement learning to better align LLMs for cross-sentence rewriting tasks using diverse wording and structures expressed through natural languages including 1) generating rewriting instruction data from Wiki edits and public corpus through instruction generation and chain-of-thought prompting; 2) collecting comparison data for reward model training through a new ranking function.
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Scaling language models with more data, compute and parameters has driven significant progress in natural language processing.
Ranked #10 on
Language Modelling
on LAMBADA
Corpora Generation for Grammatical Error Correction
We provide systematic analysis that compares the two approaches to data generation and highlights the effectiveness of ensembling.
