Search Results for author:
Found 1 papers, 0 papers with code
What Can Transformer Learn with Varying Depth? Case Studies on Sequence Learning Tasks
Specifically, we designed a novel set of sequence learning tasks to systematically evaluate and comprehend how the depth of transformer affects its ability to perform memorization, reasoning, generalization, and contextual generalization.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
