Search Results for author:
Found 2 papers, 2 papers with code
TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back) using Taylor-Softmax
The quadratic complexity of the attention mechanism represents one of the biggest hurdles for processing long sequences using Transformers.
Which Transformer to Favor: A Comparative Analysis of Efficiency in Vision Transformers
This benchmark provides a standardized baseline across the landscape of efficiency-oriented transformers and our framework of analysis, based on Pareto optimality, reveals surprising insights.
Ranked #264 on
Image Classification
on ImageNet
Cannot find the paper you are looking for? You can
Submit a new open access paper.
