AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models

no code implementations • 20 Mar 2024 • Zeyu Liu, Souvik Kundu, Anni Li, Junrui Wan, Lianghao Jiang, Peter Anthony Beerel

While compared in terms of runtime, AFLoRA can yield up to $1. 86\times$ improvement as opposed to similar PEFT alternatives.