Search Results for author:
Found 2 papers, 1 papers with code
Tighter Bounds on the Expressivity of Transformer Encoders
Characterizing neural networks in terms of better-understood formal systems has the potential to yield new insights into the power and limitations of these networks.
Overcoming a Theoretical Limitation of Self-Attention
We examine this limitation using two languages: PARITY, the language of bit strings with an odd number of 1s, and FIRST, the language of bit strings starting with a 1.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
