Event2Mind for Russian: Understanding Emotions and Intents in Texts. Corpus and Model for Evaluation
The paper provides a comprehensive overview of the corpus for the Russian language for the commonsense inference task. Namely, we construct event phrases, which cover a wide range of everyday situations with labelled intents and reactions of the event main participant and emotions of other people involved. The dataset consists of two parts: a crowdsourced corpus of 6,756 examples from Russian sources and a translated into Russian part of the original corpus of 23,409 examples. Apart from this, we use the collected data in order to train the event2mind model for the Russian language. The paper presents careful description of the best Russian model and the results of the conducted experiments.
PDFCode
Tasks
Datasets
Event2Mind
Russian Event2Mind
| Task | Dataset | Model | Metric Name | Metric Value | Global Rank | Benchmark |
|---|---|---|---|---|---|---|
| Common Sense Reasoning | Russian Event2Mind | araneum word2vec (skipgram) + GRU | recall@10 | 0.827 | # 1 | |
| Common Sense Reasoning | Russian Event2Mind | araneum word2vec (skipgram) + LSTM | recall@10 | 0.816 | # 7 | |
| Common Sense Reasoning | Russian Event2Mind | ruscorpora fasttext + LSTM | recall@10 | 0.821 | # 4 | |
| Common Sense Reasoning | Russian Event2Mind | araneum fasttext + LSTM | recall@10 | 0.818 | # 6 | |
| Common Sense Reasoning | Russian Event2Mind | ruscorpora fasttext + GRU | recall@10 | 0.822 | # 3 | |
| Common Sense Reasoning | Russian Event2Mind | araneum fasttext + GRU | recall@10 | 0.819 | # 5 | |
| Common Sense Reasoning | Russian Event2Mind | ruscorpora word2vec (skipgram) + GRU | recall@10 | 0.825 | # 2 |
Methods
No methods listed for this paper. Add
relevant methods here
