1 code implementation • 31 Jul 2023 • Vaibhav Adlakha, Parishad BehnamGhader, Xing Han Lu, Nicholas Meade, Siva Reddy
Guided by human evaluation and analysis, we highlight the shortcomings of traditional metrics for both correctness and faithfulness.
no code implementations • 6 May 2023 • Kaushik Moudgalya, Ankit Ramakrishnan, Vamsikrishna Chemudupati, Xing Han Lu
However, the task of time and space complexity classification from code has not been extensively explored due to a lack of datasets, with prior endeavors being limited to Java.
1 code implementation • 3 Apr 2023 • Xing Han Lu, Siva Reddy, Harm de Vries
We introduce the StatCan Dialogue Dataset consisting of 19, 379 conversation turns between agents working at Statistics Canada and online users looking for published data tables.
Ranked #1 on Table Retrieval on Statcan Dialogue Dataset
1 code implementation • Findings (ACL) 2022 • Zichao Li, Prakhar Sharma, Xing Han Lu, Jackie C. K. Cheung, Siva Reddy
We train a neural model with this feedback data that can generate explanations and re-score answer candidates.
Ranked #1 on Overall - Test on FeedbackQA
1 code implementation • EMNLP (ClinicalNLP) 2020 • Zhi Wen, Xing Han Lu, Siva Reddy
One of the biggest challenges that prohibit the use of many current NLP methods in clinical settings is the availability of public datasets.
Ranked #1 on Mortality Prediction on MIMIC-III (Accuracy metric)