2 code implementations • 16 Feb 2024 • Yaroslav Aksenov, Nikita Balagansky, Sofia Maria Lo Cicero Vaina, Boris Shaposhnikov, Alexey Gorbatovski, Daniil Gavrilov
Advancing the frontier of subquadratic architectures for Language Models (LMs) is crucial in the rapidly evolving field of natural language processing.
no code implementations • 18 May 2023 • Sofia Maria Lo Cicero Vaina, Nikita Balagansky, Daniil Gavrilov
We evaluate our methods on Plaid, SSD, and CDCD DLMs and create a cohesive perspective on their generation workflows.