no code implementations • 14 Aug 2023 • Benjamin LeBrun, Sharon Temtsin, Andrew Vonasch, Christoph Bartneck
Researchers currently have to rely on the disinterest of bad actors to successfully use open-ended responses as a useful tool for ensuring data quality.
no code implementations • ICLR 2022 • Benjamin LeBrun, Alessandro Sordoni, Timothy J. O'Donnell
To address this gap, we develop a controlled evaluation scheme which uses generative models trained on natural data as artificial languages from which we can exactly compute sequence probabilities.