Search Results for author: Soroush Tabesh

Found 3 papers, 2 papers with code

RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation

2 code implementations9 Jan 2024 Mahdi Nikdan, Soroush Tabesh, Elvir Crnčević, Dan Alistarh

We investigate parameter-efficient fine-tuning (PEFT) methods that can provide good accuracy under limited computational and memory budgets in the context of large language models (LLMs).

Math parameter-efficient fine-tuning +1

Vision Models Can Be Efficiently Specialized via Few-Shot Task-Aware Compression

no code implementations25 Mar 2023 Denis Kuznedelev, Soroush Tabesh, Kimia Noorbakhsh, Elias Frantar, Sara Beery, Eldar Kurtic, Dan Alistarh

To address this, we ask: can we quickly compress large generalist models into accurate and efficient specialists?

Cannot find the paper you are looking for? You can Submit a new open access paper.