Search Results for author: Soroush Tabesh

Found 2 papers, 1 papers with code

RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation

1 code implementation9 Jan 2024 Mahdi Nikdan, Soroush Tabesh, Elvir Crnčević, Dan Alistarh

We investigate parameter-efficient fine-tuning (PEFT) methods that can provide good accuracy under limited computational and memory budgets in the context of large language models (LLMs).

Math Quantization

Vision Models Can Be Efficiently Specialized via Few-Shot Task-Aware Compression

no code implementations25 Mar 2023 Denis Kuznedelev, Soroush Tabesh, Kimia Noorbakhsh, Elias Frantar, Sara Beery, Eldar Kurtic, Dan Alistarh

To address this, we ask: can we quickly compress large generalist models into accurate and efficient specialists?

Cannot find the paper you are looking for? You can Submit a new open access paper.