no code implementations • 13 Mar 2025 • Nicholas Deas, Blake Vente, Amith Ananthram, Jessica A. Grieser, Desmond Patton, Shana Kleiner, James Shepard, Kathleen McKeown
With a combination of quantitative experiments, human judgments, and qualitative analyses, we evaluate the quantity and quality of African American Language (AAL) representation in 12 predominantly English, open-source pretraining corpora.
1 code implementation • 18 Feb 2025 • Joel Mire, Zubin Trivadi Aysola, Daniel Chechelnitsky, Nicholas Deas, Chrysoula Zerva, Maarten Sap
Preference alignment via reward models helps build safe, helpful, and reliable large language models (LLMs).
no code implementations • 6 Nov 2024 • Nicholas Deas, Kathleen McKeown
Global partisan hostility and polarization has increased, and this polarization is heightened around presidential elections.
1 code implementation • 16 Jul 2024 • Nicholas Deas, Elsbeth Turcan, Iván Pérez Mejía, Kathleen McKeown
In the field of emotion analysis, much NLP research focuses on identifying a limited number of discrete emotion categories, often applied across languages.
no code implementations • 23 May 2023 • Nicholas Deas, Jessi Grieser, Shana Kleiner, Desmond Patton, Elsbeth Turcan, Kathleen McKeown
We evaluate how well LLMs understand African American Language (AAL) in comparison to their performance on White Mainstream English (WME), the encouraged "standard" form of English taught in American classrooms.