SemEval-2018 Task 10: Capturing Discriminative Attributes

SEMEVAL 2018  ·  Alicia Krebs, Aless Lenci, ro, Denis Paperno ·

This paper describes the SemEval 2018 Task 10 on Capturing Discriminative Attributes. Participants were asked to identify whether an attribute could help discriminate between two concepts. For example, a successful system should determine that {`}urine{'} is a discriminating feature in the word pair {`}kidney{'}, {`}bone{'}. The aim of the task is to better evaluate the capabilities of state of the art semantic models, beyond pure semantic similarity. The task attracted submissions from 21 teams, and the best system achieved a 0.75 F1 score.

PDF Abstract

Datasets


  Add Datasets introduced or used in this paper

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods


No methods listed for this paper. Add relevant methods here