Sparse Double Descent in Vision Transformers: real or phantom threat?

1 code implementation • 26 Jul 2023 • Victor Quétu, Marta Milovanovic, Enzo Tartaglione

Vision transformers (ViT) have been of broad interest in recent theoretical and empirical works.

Inductive Bias