Don't Blame the Data, Blame the Model: Understanding Noise and Bias When Learning from Subjective Annotations

1 code implementation • 6 Mar 2024 • Abhishek Anand, Negar Mokhberian, Prathyusha Naresh Kumar, Anweasha Saha, Zihao He, Ashwin Rao, Fred Morstatter, Kristina Lerman

Researchers have raised awareness about the harms of aggregating labels especially in subjective tasks that naturally contain disagreements among human annotators.