Improving Text-to-SQL Evaluation Methodology

ACL 2018 Catherine Finegan-DollakJonathan K. KummerfeldLi ZhangKarthik RamanathanSesh SadasivamRui ZhangDragomir Radev

To be informative, an evaluation must measure how well systems generalize to realistic unseen data. We identify limitations of and propose improvements to current evaluations of text-to-SQL systems... (read more)

PDF Abstract

Evaluation results from the paper


  Submit results from this paper to get state-of-the-art GitHub badges and help community compare results to other papers.