no code implementations • 20 Feb 2024 • Maohao Shen, Subhro Das, Kristjan Greenewald, Prasanna Sattigeri, Gregory Wornell, Soumya Ghosh
Addressing these challenges, we propose THERMOMETER, a calibration approach tailored to LLMs.
no code implementations • 9 Feb 2024 • J. Jon Ryu, Maohao Shen, Soumya Ghosh, Yuheng Bu, Prasanna Sattigeri, Subhro Das, Gregory W. Wornell
This paper explores a modern predictive uncertainty estimation approach, called evidential deep learning (EDL), in which a single neural network model is trained to learn a meta distribution over the predictive distribution by minimizing a specific objective function.
1 code implementation • 30 Apr 2023 • Maohao Shen, Soumya Ghosh, Prasanna Sattigeri, Subhro Das, Yuheng Bu, Gregory Wornell
Due to privacy or commercial constraints, large pre-trained language models (PLMs) are often offered as black-box APIs.
no code implementations • 16 Feb 2023 • Abhin Shah, Maohao Shen, Jongha Jon Ryu, Subhro Das, Prasanna Sattigeri, Yuheng Bu, Gregory W. Wornell
To overcome this limitation, we propose a bootstrap-based algorithm that achieves the target level of fairness despite the uncertainty in sensitive attributes.
1 code implementation • 14 Dec 2022 • Maohao Shen, Yuheng Bu, Prasanna Sattigeri, Soumya Ghosh, Subhro Das, Gregory Wornell
It is known that neural networks have the problem of being over-confident when directly using the output label distribution to generate uncertainty measures.
no code implementations • 1 Nov 2022 • Maohao Shen, Bowen Jiang, Jacky Yibo Zhang, Oluwasanmi Koyejo
Active learning enables efficient model training by leveraging interactions between machine learning agents and human annotators.
1 code implementation • 1 Feb 2022 • Maohao Shen, Yuheng Bu, Gregory Wornell
Due to privacy, storage, and other constraints, there is a growing need for unsupervised domain adaptation techniques in machine learning that do not require access to the data used to train a collection of source models.
Source-Free Domain Adaptation Unsupervised Domain Adaptation
no code implementations • 29 Sep 2021 • Maohao Shen, Bowen Jiang, Jacky Y. Zhang, Oluwasanmi O Koyejo
We propose a novel and general framework (i. e., SABAL) that formulates batch active learning as a sparse approximation problem.
no code implementations • 8 Aug 2020 • Bowen Jiang, Maohao Shen
When performing classification tasks, raw high dimensional features often contain redundant information, and lead to increased computational complexity and overfitting.