SentEval: An Evaluation Toolkit for Universal Sentence Representations

LREC 2018  ·  Alexis Conneau, Douwe Kiela ·

We introduce SentEval, a toolkit for evaluating the quality of universal sentence representations. SentEval encompasses a variety of tasks, including binary and multi-class classification, natural language inference and sentence similarity... The set of tasks was selected based on what appears to be the community consensus regarding the appropriate evaluations for universal sentence representations. The toolkit comes with scripts to download and preprocess datasets, and an easy interface to evaluate sentence encoders. The aim is to provide a fairer, less cumbersome and more centralized way for evaluating sentence representations. read more

PDF Abstract LREC 2018 PDF LREC 2018 Abstract

Datasets


Introduced in the Paper:

SentEval

Used in the Paper:

COCO SST SNLI MPQA Opinion Corpus

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods


No methods listed for this paper. Add relevant methods here