Search Results for author:
Found 4 papers, 4 papers with code
Recurrent Memory Transformer
We implement a memory mechanism with no changes to Transformer model by adding special memory tokens to the input or output sequence.
Scaling Transformer to 1M tokens and beyond with RMT
A major limitation for the broader scope of problems solvable by transformers is the quadratic scaling of computational complexity with input size.
In Search of Needles in a 11M Haystack: Recurrent Memory Finds What LLMs Miss
This paper addresses the challenge of processing long documents using generative transformer models.
Better Together: Enhancing Generative Knowledge Graph Completion with Language Models and Neighborhood Information
In this study, we propose to include node neighborhoods as additional information to improve KGC methods based on language models.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
