no code implementations • 21 Feb 2024 • Ashutosh Sathe, Prachi Jain, Sunayana Sitaram
Large vision-language models (VLMs) are widely getting adopted in industry and academia.
no code implementations • 12 Feb 2024 • Prachi Jain, Ashutosh Sathe, Varun Gumma, Kabir Ahuja, Sunayana Sitaram
In this work, we aim to modularly debias a pretrained language model across multiple dimensions.
no code implementations • 15 Jan 2024 • Divyanshu Aggarwal, Ashutosh Sathe, Ishaan Watts, Sunayana Sitaram
Prior work on multilingual evaluation has shown that there is a large gap between the performance of LLMs on English and other languages.
no code implementations • 13 Nov 2023 • Sanchit Ahuja, Divyanshu Aggarwal, Varun Gumma, Ishaan Watts, Ashutosh Sathe, Millicent Ochieng, Rishav Hada, Prachi Jain, Maxamed Axmed, Kalika Bali, Sunayana Sitaram
We also perform a study on data contamination and find that several models are likely to be contaminated with multilingual evaluation benchmarks, necessitating approaches to detect and handle contamination while assessing the multilingual performance of LLMs.
1 code implementation • 20 Oct 2023 • Adithya Bhaskar, Tushar Tomar, Ashutosh Sathe, Sunita Sarawagi
Research in Text-to-SQL conversion has been largely benchmarked against datasets where each text query corresponds to one correct SQL.
no code implementations • 29 Oct 2022 • Abhijeet Awasthi, Ashutosh Sathe, Sunita Sarawagi
Text-to-SQL parsers typically struggle with databases unseen during the train time.