Search Results for author:
Found 1 papers, 0 papers with code
Successor Heads: Recurring, Interpretable Attention Heads In The Wild
In this work we present successor heads: attention heads that increment tokens with a natural ordering, such as numbers, months, and days.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
