Search Results for author: Sacha Benarroch-Lelong

Found 1 papers, 0 papers with code

Hyperparameter Optimization for Large Language Model Instruction-Tuning

no code implementations1 Dec 2023 Christophe Tribes, Sacha Benarroch-Lelong, Peng Lu, Ivan Kobyzev

The performance on downstream tasks of models fine-tuned with LoRA heavily relies on a set of hyperparameters including the rank of the decomposition.

Hyperparameter Optimization Language Modelling +1

Cannot find the paper you are looking for? You can Submit a new open access paper.