Document-level Relation Extraction with Context Guided Mention Integration and Inter-pair Reasoning

13 Jan 2022  ·  Chao Zhao, Daojian Zeng, Lu Xu, Jianhua Dai ·

Document-level Relation Extraction (DRE) aims to recognize the relations between two entities. The entity may correspond to multiple mentions that span beyond sentence boundary. Few previous studies have investigated the mention integration, which may be problematic because coreferential mentions do not equally contribute to a specific relation. Moreover, prior efforts mainly focus on reasoning at entity-level rather than capturing the global interactions between entity pairs. In this paper, we propose two novel techniques, Context Guided Mention Integration and Inter-pair Reasoning (CGM2IR), to improve the DRE. Instead of simply applying average pooling, the contexts are utilized to guide the integration of coreferential mentions in a weighted sum manner. Additionally, inter-pair reasoning executes an iterative algorithm on the entity pair graph, so as to model the interdependency of relations. We evaluate our CGM2IR model on three widely used benchmark datasets, namely DocRED, CDR, and GDA. Experimental results show that our model outperforms previous state-of-the-art models.

PDF Abstract

Datasets


Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Relation Extraction CDR CGM2IR-SciBERTbase F1 73.8 # 5
Relation Extraction DocRED CGM2IR-RoBERTalarge F1 63.89 # 7
Ign F1 61.96 # 7
Relation Extraction DocRED CGM2IR-BERTbase F1 62.06 # 18
Ign F1 60.24 # 17
Relation Extraction GDA CGM2IR-SciBERTbase F1 84.7 # 6

Methods


No methods listed for this paper. Add relevant methods here