Search Results for author:
Found 5 papers, 3 papers with code
Propagation and Pitfalls: Reasoning-based Assessment of Knowledge Editing through Counterfactual Tasks
Our analysis over the chain-of-thought generation of edited models further uncover key reasons behind the inadequacy of existing knowledge editing methods from a reasoning standpoint, involving aspects on fact-wise editing, fact recall ability, and coherence in generation.
UNITE: A Unified Benchmark for Text-to-SQL Evaluation
A practical text-to-SQL system should generalize well on a wide variety of natural language questions, unseen database schemas, and novel SQL query structures.
Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness
Neural text-to-SQL models have achieved remarkable performance in translating natural language questions into SQL queries.
Robust Information Retrieval for False Claims with Distracting Entities In Fact Extraction and Verification
A BERT-based retrieval model made more mistakes in retrieving refuting evidence for false claims than supporting evidence for true claims.
Convolutional Neural Network Achieves Human-level Accuracy in Music Genre Classification
Here, we propose a new method that combines knowledge of human perception study in music genre classification and the neurophysiology of the auditory system.
