|Trend||Dataset||Best Method||Paper title||Paper||Code||Compare|
We present CoSQL, a corpus for building cross-domain, general-purpose database (DB) querying dialogue systems.
We focus on the cross-domain context-dependent text-to-SQL generation task.
We present a simple way to do the task of text-to-SQL problem with weak supervision.
When translating natural language questions into SQL queries to answer questions from a database, we would like our methods to generalize to domains and database schemas outside of the training set.
The best model obtains an exact match accuracy of 20. 2% over all questions and less than10% over all interaction sequences, indicating that the cross-domain setting and the con-textual phenomena of the dataset present significant challenges for future research.
We define a new complex and cross-domain semantic parsing and text-to-SQL task where different complex SQL queries and databases appear in train and test sets.
SOTA for Semantic Parsing on spider
Second, we show that the current division of data into training and test sets measures robustness to variations in the way questions are asked, but only partially tests how well systems generalize to new queries; therefore, we propose a complementary dataset split for evaluation of future work.