Annotations on a Budget: Leveraging Geo-Data Similarity to Balance Model Performance and Annotation Cost

1 code implementation • 12 Mar 2024 • Oana Ignat, Longju Bai, Joan Nwatu, Rada Mihalcea

In this paper, we propose methods to identify the data to be annotated to balance model performance and annotation costs.

Bridging the Digital Divide: Performance Variation across Socio-Economic Factors in Vision-Language Models

1 code implementation • 9 Nov 2023 • Joan Nwatu, Oana Ignat, Rada Mihalcea

Despite the impressive performance of current AI models reported across various tasks, performance reports often do not include evaluations of how these models perform on the specific groups that will be impacted by these technologies.

Language Modelling

Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models

no code implementations • 21 May 2023 • Oana Ignat, Zhijing Jin, Artem Abzaliev, Laura Biester, Santiago Castro, Naihao Deng, Xinyi Gao, Aylin Gunal, Jacky He, Ashkan Kazemi, Muhammad Khalifa, Namho Koh, Andrew Lee, Siyang Liu, Do June Min, Shinka Mori, Joan Nwatu, Veronica Perez-Rosas, Siqi Shen, Zekun Wang, Winston Wu, Rada Mihalcea

Not surprisingly, this has, in turn, made many NLP researchers -- especially those at the beginning of their careers -- worry about what NLP research area they should focus on.