Search Results for author:
Found 11 papers, 9 papers with code
In Search of Needles in a 11M Haystack: Recurrent Memory Finds What LLMs Miss
This paper addresses the challenge of processing long documents using generative transformer models.
Better Together: Enhancing Generative Knowledge Graph Completion with Language Models and Neighborhood Information
In this study, we propose to include node neighborhoods as additional information to improve KGC methods based on language models.
Scaling Transformer to 1M tokens and beyond with RMT
A major limitation for the broader scope of problems solvable by transformers is the quadratic scaling of computational complexity with input size.
Recurrent Memory Transformer
We implement a memory mechanism with no changes to Transformer model by adding special memory tokens to the input or output sequence.
Knowledge Distillation of Russian Language Models with Reduction of Vocabulary
We propose two simple yet effective alignment techniques to make knowledge distillation to the students with reduced vocabulary.
Memory Transformer
Adding trainable memory to selectively store local as well as global representations of a sequence is a promising direction to improve the Transformer model.
Goal-Oriented Multi-Task BERT-Based Dialogue State Tracker
The organizers introduced the Schema-Guided Dialogue (SGD) dataset with multi-domain conversations and released a zero-shot dialogue state tracking model.
Tuning Multilingual Transformers for Language-Specific Named Entity Recognition
Our paper addresses the problem of multilingual named entity recognition on the material of 4 languages: Russian, Bulgarian, Czech and Polish.
Multilingual Named Entity Recognition
named-entity-recognition
+3
Adaptation of Deep Bidirectional Multilingual Transformers for Russian Language
This work shows that transfer learning from a multilingual model to monolingual model results in significant growth of performance on such tasks as reading comprehension, paraphrase detection, and sentiment analysis.
Ranked #1 on
Question Answering
on SQuAD1.1
(Hardware Burden metric)
Tuning Multilingual Transformers for Named Entity Recognition on Slavic Languages
Our paper addresses the problem of multilingual named entity recognition on the material of 4 languages: Russian, Bulgarian, Czech and Polish.
Multilingual Named Entity Recognition
named-entity-recognition
+3
DeepPavlov: Open-Source Library for Dialogue Systems
It supports modular as well as end-to-end approaches to implementation of conversational agents.
