RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation

1 code implementation • 9 Jan 2024 • Mahdi Nikdan, Soroush Tabesh, Elvir Crnčević, Dan Alistarh

We investigate parameter-efficient fine-tuning (PEFT) methods that can provide good accuracy under limited computational and memory budgets in the context of large language models (LLMs).

Math Quantization