no code implementations • 11 Jul 2024 • Jennifer Healey, Laurie Byrum, Md Nadeem Akhtar, Moumita Sinha
Prior methods of benchmarking bias use techniques such as word masking and multiple choice questions to assess bias at scale, but these do not capture all of the nuanced types of bias that can occur in free response answers, the types of answers typically generated by LLM systems.
no code implementations • 3 Nov 2022 • Shiv Shankar, Ritwik Sinha, Saayan Mitra, Viswanathan Swaminathan, Sridhar Mahadevan, Moumita Sinha
We propose a two-stage experimental design, where the two brands only need to agree on high-level aggregate parameters of the experiment to test the alternate experiences.
no code implementations • WS 2020 • Anthony Colas, Trung Bui, Franck Dernoncourt, Moumita Sinha, Doo Soon Kim
Many users communicate with chatbots and AI assistants in order to help them with various tasks.
no code implementations • 26 Apr 2020 • Po-Ming Law, Sana Malik, Fan Du, Moumita Sinha
Semi-automated bias detection tools often present reports of automatically-detected biases using a recommendation list or visual cues.
no code implementations • 21 Apr 2020 • Harvineet Singh, Moumita Sinha, Atanu R. Sinha, Sahil Garg, Neha Banerjee
We posit that emails are likely to be opened sooner when send times are convenient for recipients, while for other send times, emails can get ignored.
no code implementations • 13 Mar 2020 • Po-Ming Law, Sana Malik, Fan Du, Moumita Sinha
Machine learning models often make predictions that bias against certain subgroups of input data.
no code implementations • 18 Aug 2019 • Moumita Sinha, Vishwa Vinay, Harvineet Singh
In this paper we use a survival analysis framework to predict the time to open an email once it has been received.