Contextualizing the Limits of Model & Evaluation Dataset Curation on Semantic Similarity Classification Tasks

no code implementations • 3 Nov 2023 • Daniel Theron

This paper demonstrates how the limitations of pre-trained models and open evaluation datasets factor into assessing the performance of binary semantic similarity classification tasks.

Classification Friction +2

Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing

no code implementations • 3 Jan 2020 • Inioluwa Deborah Raji, Andrew Smart, Rebecca N. White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, Parker Barnes

Rising concern for the societal implications of artificial intelligence systems has inspired a wave of academic and journalistic literature in which deployed systems are audited for harm by investigators from outside the organizations deploying the algorithms.

Computers and Society