no code implementations • 16 Nov 2023 • Adithya Renduchintala, Tugrul Konuk, Oleksii Kuchaiev
We introduce Tied-LoRA, a novel paradigm leveraging weight tying and selective training to enhance the parameter efficiency of Low-rank Adaptation (LoRA).
