Search Results for author:
Found 1 papers, 0 papers with code
Does Transformer Interpretability Transfer to RNNs?
Recent advances in recurrent neural network architectures, such as Mamba and RWKV, have enabled RNNs to match or exceed the performance of equal-size transformers in terms of language modeling perplexity and downstream evaluations, suggesting that future systems may be built on completely new architectures.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
