Luminoso at SemEval-2018 Task 10: Distinguishing Attributes Using Text Corpora and Relational Knowledge

SEMEVAL 2018  ·  Robyn Speer, Joanna Lowry-Duda ·

Luminoso participated in the SemEval 2018 task on "Capturing Discriminative Attributes" with a system based on ConceptNet, an open knowledge graph focused on general knowledge. In this paper, we describe how we trained a linear classifier on a small number of semantically-informed features to achieve an $F_1$ score of 0.7368 on the task, close to the task's high score of 0.75.

PDF Abstract SEMEVAL 2018 PDF SEMEVAL 2018 Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Relation Extraction SemEval 2018 Task 10 SVM with ConceptNet, Wikipedia articles and WordNet synonyms F1-Score 0.74 # 2

Methods


No methods listed for this paper. Add relevant methods here