Message Passing for Hyper-Relational Knowledge Graphs

Hyper-relational knowledge graphs (KGs) (e.g., Wikidata) enable associating additional key-value pairs along with the main triple to disambiguate, or restrict the validity of a fact. In this work, we propose a message passing based graph encoder - StarE capable of modeling such hyper-relational KGs. Unlike existing approaches, StarE can encode an arbitrary number of additional information (qualifiers) along with the main triple while keeping the semantic roles of qualifiers and triples intact. We also demonstrate that existing benchmarks for evaluating link prediction (LP) performance on hyper-relational KGs suffer from fundamental flaws and thus develop a new Wikidata-based dataset - WD50K. Our experiments demonstrate that StarE based LP model outperforms existing approaches across multiple benchmarks. We also confirm that leveraging qualifiers is vital for link prediction with gains up to 25 MRR points compared to triple-based representations.

PDF Abstract EMNLP 2020 PDF EMNLP 2020 Abstract

Datasets


Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Link Prediction JF17K StarE (H) + Transformer (H) MRR 0.574 # 2
Hit@1 0.496 # 1
Hit@10 0.725 # 1
Hit@5 0.658 # 1
Link Prediction Temp8 StarE (H) + Transformer (H) MRR 0.349 # 2
Hit@1 0.271 # 2
Hit@10 0.496 # 2

Methods


No methods listed for this paper. Add relevant methods here