Search Results for author:
Found 3 papers, 2 papers with code
Transformer verbatim in-context retrieval across time and scale
We further found that the development of verbatim in-context retrieval is positively correlated with the learning of zero-shot benchmarks.
Characterizing Verbatim Short-Term Memory in Neural Language Models
We tested whether language models could retrieve the exact words that occurred previously in a text.
Short-term memory in neural language models
Thus, although the transformer and LSTM architectures were both trained to predict language sequences, only the transformer learned to flexibly index prior tokens.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
