TERRa (Textual Entailment Recognition for Russian)

Introduced by Shavrina et al. in RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark

Textual Entailment Recognition has been proposed recently as a generic task that captures major semantic inference needs across many NLP applications, such as Question Answering, Information Retrieval, Information Extraction, and Text Summarization. This task requires to recognize, given two text fragments, whether the meaning of one text is entailed (can be inferred) from the other text.

Task Type

RTE (Recognizing Textual Entailment) Sentence Pair Classification - Entailment - Not Entailment

Example

{
  "premise": "Автор поста написал в комментарии, что прорвалась канализация.",
  "hypothesis": "Автор поста написал про канализацию.",
  "label": "entailment",
  "idx": "6062"
}

How did we collect data?

All text examples were collected from open news sources and literary magazines, then manually reviewed and supplemented by a human assessment on Yandex.Toloka

Papers


Paper Code Results Date Stars

Dataset Loaders


No data loaders found. You can submit your data loader here.

Tasks


Similar Datasets


License


Modalities


Languages