TabFact: A Large-scale Dataset for Table-based Fact Verification

5 Sep 2019Wenhu ChenHongmin WangJianshu ChenYunkai ZhangHong WangShiyang LiXiyou ZhouWilliam Yang Wang

The problem of verifying whether a textual hypothesis holds based on the given evidence, also known as fact verification, plays an important role in the study of natural language understanding and semantic representation. However, existing studies are mainly restricted to dealing with unstructured evidence (e.g., natural language sentences and documents, news, etc), while verification under structured evidence, such as tables, graphs, and databases, remains unexplored... (read more)

PDF Abstract

Evaluation Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK COMPARE
Table-based Fact Verification TabFact Table-BERT-Horizontal-T+F-Template Test 65.12 # 1
Table-based Fact Verification TabFact Table-BERT-Horizontal-T+F-Template Val 66.1 # 1
Table-based Fact Verification TabFact BERT classifier w/o Table Test 50.5 # 2
Table-based Fact Verification TabFact BERT classifier w/o Table Val 50.9 # 2