Evaluating Semantic Parsing against a Simple Web-based Question Answering Model

SEMEVAL 2017 Alon TalmorMor GevaJonathan Berant

Semantic parsing shines at analyzing complex natural language that involves composition and computation over multiple pieces of evidence. However, datasets for semantic parsing contain many factoid questions that can be answered from a single web document... (read more)

PDF Abstract

Evaluation results from the paper

Task Dataset Model Metric name Metric value Global rank Compare
Question Answering COMPLEXQUESTIONS WebQA F1 53.6 # 1