no code implementations • 1 Dec 2023 • Christophe Tribes, Sacha Benarroch-Lelong, Peng Lu, Ivan Kobyzev
The performance on downstream tasks of models fine-tuned with LoRA heavily relies on a set of hyperparameters including the rank of the decomposition.