Search Results for author:
Found 8 papers, 6 papers with code
Recurrent Memory Transformer
We implement a memory mechanism with no changes to Transformer model by adding special memory tokens to the input or output sequence.
Knowledge Distillation of Russian Language Models with Reduction of Vocabulary
We propose two simple yet effective alignment techniques to make knowledge distillation to the students with reduced vocabulary.
Memory Transformer
Adding trainable memory to selectively store local as well as global representations of a sequence is a promising direction to improve the Transformer model.
Goal-Oriented Multi-Task BERT-Based Dialogue State Tracker
The organizers introduced the Schema-Guided Dialogue (SGD) dataset with multi-domain conversations and released a zero-shot dialogue state tracking model.
Tuning Multilingual Transformers for Language-Specific Named Entity Recognition
Our paper addresses the problem of multilingual named entity recognition on the material of 4 languages: Russian, Bulgarian, Czech and Polish.
Multilingual Named Entity Recognition
named-entity-recognition
+2
Adaptation of Deep Bidirectional Multilingual Transformers for Russian Language
This work shows that transfer learning from a multilingual model to monolingual model results in significant growth of performance on such tasks as reading comprehension, paraphrase detection, and sentiment analysis.
Ranked #1 on
Question Answering
on SQuAD1.1
(Hardware Burden metric)
Tuning Multilingual Transformers for Named Entity Recognition on Slavic Languages
Our paper addresses the problem of multilingual named entity recognition on the material of 4 languages: Russian, Bulgarian, Czech and Polish.
Multilingual Named Entity Recognition
named-entity-recognition
+2
DeepPavlov: Open-Source Library for Dialogue Systems
It supports modular as well as end-to-end approaches to implementation of conversational agents.
