no code implementations • 13 Apr 2024 • Yibo Zhong, Yao Zhou
In this paper, we propose Head-level Efficient Adaptation with Taylor-expansion importance score (HEAT): a simple method that efficiently fine-tuning ViTs at head levels.
Transfer Learning