CRIM at SemEval-2018 Task 9: A Hybrid Approach to Hypernym Discovery
This report describes the system developed by the CRIM team for the hypernym discovery task at SemEval 2018. This system exploits a combination of supervised projection learning and unsupervised pattern-based hypernym discovery. It was ranked first on the 3 sub-tasks for which we submitted results.
PDF AbstractDatasets
Task | Dataset | Model | Metric Name | Metric Value | Global Rank | Benchmark |
---|---|---|---|---|---|---|
Hypernym Discovery | General | CRIM | MAP | 19.78 | # 1 | |
MRR | 36.10 | # 1 | ||||
P@5 | 19.03 | # 1 | ||||
Hypernym Discovery | Medical domain | CRIM | MAP | 34.05 | # 1 | |
MRR | 54.64 | # 1 | ||||
P@5 | 36.77 | # 1 | ||||
Hypernym Discovery | Music domain | CRIM | MAP | 40.97 | # 1 | |
MRR | 60.93 | # 1 | ||||
P@5 | 41.31 | # 1 |