The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI

1 code implementation • 25 Oct 2023 • Shayne Longpre, Robert Mahari, Anthony Chen, Naana Obeng-Marnu, Damien Sileo, William Brannon, Niklas Muennighoff, Nathan Khazam, Jad Kabbara, Kartik Perisetla, Xinyi Wu, Enrico Shippole, Kurt Bollacker, Tongshuang Wu, Luis Villa, Sandy Pentland, Sara Hooker

The race to train language models on vast, diverse, and inconsistently documented datasets has raised pressing concerns about the legal and ethical risks for practitioners.

Entity-Based Knowledge Conflicts in Question Answering

1 code implementation • EMNLP 2021 • Shayne Longpre, Kartik Perisetla, Anthony Chen, Nikhil Ramesh, Chris DuBois, Sameer Singh

To understand how models use these sources together, we formalize the problem of knowledge conflicts, where the contextual information contradicts the learned information.

Hallucination Out-of-Distribution Generalization +1