Search Results for author:
Found 1 papers, 0 papers with code
Wonderful Matrices: More Efficient and Effective Architecture for Language Modeling Tasks
We prove the availability of inner product form position encoding in the state space dual algorithm and study the effectiveness of different position embeddings in the hybrid quadratic causal self-attention and state space dual algorithms.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
