no code implementations • 11 Nov 2021 • Burcu Sayin, Jie Yang, Andrea Passerini, Fabio Casati
We motivate why the science of learning to reject model predictions is central to ML, and why human computation has a lead role in this effort.
no code implementations • 11 Nov 2020 • Evgeny Krivosheev, Burcu Sayin, Alessandro Bozzon, Zoltán Szlávik
In this paper, we explore how to efficiently combine crowdsourcing and machine intelligence for the problem of document screening, where we need to screen documents with a set of machine-learning filters.