Search Results for author: Sam Havens

Found 4 papers, 2 papers with code

LoRA Learns Less and Forgets Less

1 code implementation15 May 2024 Dan Biderman, Jacob Portes, Jose Javier Gonzalez Ortiz, Mansheej Paul, Philip Greengard, Connor Jennings, Daniel King, Sam Havens, Vitaliy Chiley, Jonathan Frankle, Cody Blakeney, John P. Cunningham

In this work, we compare the performance of LoRA and full finetuning on two target domains, programming and mathematics.

LIMIT: Less Is More for Instruction Tuning Across Evaluation Paradigms

no code implementations22 Nov 2023 Aditi Jha, Sam Havens, Jeremey Dohmann, Alex Trott, Jacob Portes

We find that subsets of 1k-6k instruction finetuning samples are sufficient to achieve good performance on both (1) traditional NLP benchmarks and (2) model-based evaluation.

Instruction Following

Cannot find the paper you are looking for? You can Submit a new open access paper.