Search Results for author:
Found 1 papers, 0 papers with code
Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Models
In this paper, we instead demonstrate that Transformers learn to implement higher-order optimization methods to perform ICL.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
