no code implementations • 12 Feb 2024 • Mirelle Bueno, Roberto Lotufo, Rodrigo Nogueira
Language models are now capable of solving tasks that require dealing with long sequences consisting of hundreds of thousands of tokens.
1 code implementation • 24 Aug 2022 • Mirelle Bueno, Carlos Gemmell, Jeffrey Dalton, Roberto Lotufo, Rodrigo Nogueira
Our experimental results show that generating step-by-step rationales and introducing marker tokens are both required for effective extrapolation.