Temporal Knowledge Base Completion: New Algorithms and Evaluation Protocols

EMNLP 2020  ·  Prachi Jain, Sushant Rathi, Mausam, Soumen Chakrabarti ·

Temporal knowledge bases associate relational (s,r,o) triples with a set of times (or a single time instant) when the relation is valid. While time-agnostic KB completion (KBC) has witnessed significant research, temporal KB completion (TKBC) is in its early days... In this paper, we consider predicting missing entities (link prediction) and missing time intervals (time prediction) as joint TKBC tasks where entities, relations, and time are all embedded in a uniform, compatible space. We present TIMEPLEX, a novel time-aware KBC method, that also automatically exploits the recurrent nature of some relations and temporal interactions between pairs of relations. TIMEPLEX achieves state-of-the-art performance on both prediction tasks. We also find that existing TKBC models heavily overestimate link prediction performance due to imperfect evaluation mechanisms. In response, we propose improved TKBC evaluation protocols for both link and time prediction tasks, dealing with subtle issues that arise from the partial overlap of time intervals in gold instances and system predictions. read more

PDF Abstract EMNLP 2020 PDF EMNLP 2020 Abstract

Datasets


Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Link Prediction ICEWS05-15 TimePlex MRR 0.632 # 2
Link Prediction ICEWS14 TimePlex MRR 0.589 # 2
Link Prediction Wikidata12k TimePlex MRR 0.3335 # 1
Time-interval Prediction Wikidata12k TimePlex aeIOU@1 26.36 # 1
Link Prediction Yago11k TimePlex MRR 0.2364 # 1
Time-interval Prediction Yago11k TimePlex aeIou@1 20.03 # 1

Methods


No methods listed for this paper. Add relevant methods here