2 code implementations • 16 Feb 2024 • Yuri Kuratov, Aydar Bulatov, Petr Anokhin, Dmitry Sorokin, Artyom Sorokin, Mikhail Burtsev
This paper addresses the challenge of processing long documents using generative transformer models.
1 code implementation • 2 Nov 2023 • Alla Chepurova, Aydar Bulatov, Yuri Kuratov, Mikhail Burtsev
In this study, we propose to include node neighborhoods as additional information to improve KGC methods based on language models.
3 code implementations • 19 Apr 2023 • Aydar Bulatov, Yuri Kuratov, Yermek Kapushev, Mikhail S. Burtsev
A major limitation for the broader scope of problems solvable by transformers is the quadratic scaling of computational complexity with input size.
3 code implementations • 14 Jul 2022 • Aydar Bulatov, Yuri Kuratov, Mikhail S. Burtsev
We implement a memory mechanism with no changes to Transformer model by adding special memory tokens to the input or output sequence.