OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction

A recent state-of-the-art neural open information extraction (OpenIE) system generates extractions iteratively, requiring repeated encoding of partial outputs. This comes at a significant computational cost. On the other hand, sequence labeling approaches for OpenIE are much faster, but worse in extraction quality. In this paper, we bridge this trade-off by presenting an iterative labeling-based system that establishes a new state of the art for OpenIE, while extracting 10x faster. This is achieved through a novel Iterative Grid Labeling (IGL) architecture, which treats OpenIE as a 2-D grid labeling task. We improve its performance further by applying coverage (soft) constraints on the grid at training time. Moreover, on observing that the best OpenIE systems falter at handling coordination structures, our OpenIE system also incorporates a new coordination analyzer built with the same IGL architecture. This IGL based coordination analyzer helps our OpenIE system handle complicated coordination structures, while also establishing a new state of the art on the task of coordination analysis, with a 12.3 pts improvement in F1 over previous analyzers. Our OpenIE system, OpenIE6, beats the previous systems by as much as 4 pts in F1, while being much faster.

PDF Abstract EMNLP 2020 PDF EMNLP 2020 Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Open Information Extraction CaRB OpenIE 6 (CIGL-OIE) F1 54 # 2
Open Information Extraction CaRB IMoJIE F1 53.5 # 3
Open Information Extraction CaRB RnnOIE F1 49 # 14
Open Information Extraction CaRB SpanOIE F1 48.5 # 17
Open Information Extraction CaRB SenseOIE F1 28.2 # 28
Open Information Extraction CaRB OpenIE5 F1 48 # 19
Open Information Extraction CaRB OpenIE4 F1 51.6 # 10
Open Information Extraction CaRB ClausIE F1 45 # 21
Open Information Extraction CaRB MinIE F1 41.9 # 24
Open Information Extraction CaRB OpenIE 6 F1 52.7 # 5
Open Information Extraction WiRe57 CIGL-OIE + IGL-CA (OpenIE6) F1 40 # 1
Open Information Extraction WiRe57 MinIE F1 28.5 # 11
Open Information Extraction WiRe57 CIGL-OIE F1 36.8 # 2
Open Information Extraction WiRe57 IGL-OIE F1 34.9 # 6
Open Information Extraction WiRe57 IMoJIE F1 36 # 3
Open Information Extraction WiRe57 RnnOIE F1 26.4 # 13
Open Information Extraction WiRe57 SpanOIE F1 31.9 # 10
Open Information Extraction WiRe57 SenseOIE F1 10.7 # 18
Open Information Extraction WiRe57 OpenIE5 F1 35.4 # 5
Open Information Extraction WiRe57 OpenIE4 F1 34.4 # 7
Open Information Extraction WiRe57 ClausIE F1 33.2 # 9

Methods


No methods listed for this paper. Add relevant methods here