no code implementations • 26 Aug 2022 • Jonathan Lorraine, Nihesh Anderson, Chansoo Lee, Quentin de Laroussilhe, Mehadi Hassen
However, we cannot test the changes on production tasks.
16 code implementations • 2 Feb 2019 • Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin de Laroussilhe, Andrea Gesmundo, Mona Attariyan, Sylvain Gelly
On GLUE, we attain within 0. 4% of the performance of full fine-tuning, adding only 3. 6% parameters per task.
Ranked #4 on Image Classification on OmniBenchmark (using extra training data)
no code implementations • 27 Dec 2018 • Stanisław Jastrzębski, Quentin de Laroussilhe, Mingxing Tan, Xiao Ma, Neil Houlsby, Andrea Gesmundo
However, the success of NAS depends on the definition of the search space.