Search Results for author:
Found 61 papers, 22 papers with code
The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmers
Evaluation of large language models (LLMs) for code has primarily relied on static benchmarks, including HumanEval (Chen et al., 2021), which measure the ability of LLMs to generate complete code that passes unit tests.
Language Models in Dialogue: Conversational Maxims for Human-AI Interactions
Modern language models, while sophisticated, exhibit some inherent shortcomings, particularly in conversational settings.
Multi-Level Explanations for Generative Language Models
To address the challenges of text as output and long text inputs, we propose a general framework called MExGen that can be instantiated with different attribution algorithms.
Contextual Moral Value Alignment Through Context-Based Aggregation
Developing value-aligned AI agents is a complex undertaking and an ongoing challenge in the field of AI.
Detectors for Safe and Reliable LLMs: Implementations, Uses, and Limitations
Large language models (LLMs) are susceptible to a variety of risks, from non-faithful output to biased and toxic generations.
Causal Bandits with General Causal Models and Interventions
First, the structural causal models (SCMs) are assumed to be unknown and drawn arbitrarily from a general class $\mathcal{F}$ of Lipschitz-continuous functions.
Thermometer: Towards Universal Calibration for Large Language Models
Addressing these challenges, we propose THERMOMETER, a calibration approach tailored to LLMs.
Improved Evidential Deep Learning via a Mixture of Dirichlet Distributions
This paper explores a modern predictive uncertainty estimation approach, called evidential deep learning (EDL), in which a single neural network model is trained to learn a meta distribution over the predictive distribution by minimizing a specific objective function.
Effective Human-AI Teams via Learned Natural Language Rules and Onboarding
In this work, we propose to learn rules, grounded in data regions and described in natural language, that illustrate how the human should collaborate with the AI.
Assessment of Prediction Intervals Using Uncertainty Characteristics Curves
Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI.
Reliable Gradient-free and Likelihood-free Prompt Tuning
Due to privacy or commercial constraints, large pre-trained language models (PLMs) are often offered as black-box APIs.
Group Fairness with Uncertainty in Sensitive Attributes
To overcome this limitation, we propose a bootstrap-based algorithm that achieves the target level of fairness despite the uncertainty in sensitive attributes.
Who Should Predict? Exact Algorithms For Learning to Defer to Humans
We show that prior approaches can fail to find a human-AI system with low misclassification error even when there exists a linear classifier and rejector that have zero error (the realizable setting).
Post-hoc Uncertainty Learning using a Dirichlet Meta-Model
It is known that neural networks have the problem of being over-confident when directly using the output label distribution to generate uncertainty measures.
Fair Infinitesimal Jackknife: Mitigating the Influence of Biased Training Data Points Without Refitting
The dropping of training points is done in principle, but in practice does not require the model to be refit.
Equi-Tuning: Group Equivariant Fine-Tuning of Pretrained Models
We also provide a novel group-theoretic definition for fairness in NLG.
Causal Bandits for Linear Structural Equation Models
Two linear mechanisms, one soft intervention and one observational, are assumed for each node, giving rise to $2^N$ possible interventions.
Hard-Constrained Deep Learning for Climate Downscaling
In order to conserve physical quantities, here we introduce methods that guarantee statistical constraints are satisfied by a deep learning downscaling model, while also improving their performance according to traditional metrics.
Causal Graphs Underlying Generative Models: Path to Learning with Limited Data
In this work, we provide a simple algorithm that relies on perturbation experiments on latent codes of a pre-trained generative autoencoder to uncover a causal graph that is implied by the generative model.
A Maximal Correlation Framework for Fair Machine Learning
As machine learning algorithms grow in popularity and diversify to many industries, ethical and legal concerns regarding their fairness have become increasingly relevant.
Scalable Intervention Target Estimation in Linear Models
This paper considers the problem of estimating the unknown intervention targets in a causal directed acyclic graph from observational and interventional data.
Selective Regression Under Fairness Criteria
Selective regression allows abstention from prediction if the confidence to make an accurate prediction is not sufficient.
AI Explainability 360: Impact and Design
As artificial intelligence and machine learning algorithms become increasingly prevalent in society, multiple stakeholders are calling for these algorithms to provide explanations.
Uncertainty Quantification 360: A Holistic Toolkit for Quantifying and Communicating the Uncertainty of AI
In this paper, we describe an open source Python toolkit named Uncertainty Quantification 360 (UQ360) for the uncertainty quantification of AI models.
Uncertainty Characteristics Curves: A Systematic Assessment of Prediction Intervals
Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI.
Detector-Free Weakly Supervised Grounding by Separation
In this work, we focus on the task of Detector-Free WSG (DF-WSG) to solve WSG without relying on a pre-trained detector.
Ranked #1 on
Phrase Grounding
on Visual Genome
AdaFuse: Adaptive Temporal Fusion Network for Efficient Action Recognition
Temporal modelling is the key for efficient video action recognition.
not-so-big-GAN: Generating High-Fidelity Images on Small Compute with Wavelet-based Super-Resolution
First, we generate images in low-frequency bands by training a sampler in the wavelet domain.
A Maximal Correlation Approach to Imposing Fairness in Machine Learning
As machine learning algorithms grow in popularity and diversify to many industries, ethical and legal concerns regarding their fairness have become increasingly relevant.
Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty
Explainability attempts to provide reasons for a machine learning model's behavior to stakeholders.
Improving the Reconstruction of Disentangled Representation Learners via Multi-Stage Modeling
Current autoencoder-based disentangled representation learning methods achieve disentanglement by penalizing the (aggregate) posterior to encourage statistical independence of the latent factors.
not-so-BigGAN: Generating High-Fidelity Images on Small Compute with Wavelet-based Super-Resolution
First, we generate images in low-frequency bands by training a sampler in the wavelet domain.
Optimizing Mode Connectivity via Neuron Alignment
Yet, current curve finding algorithms do not consider the influence of symmetry in the loss surface created by model weight permutations.
AR-Net: Adaptive Frame Resolution for Efficient Action Recognition
Specifically, given a video frame, a policy network is used to decide what input resolution should be used for processing by the action recognition model, with the goal of improving both accuracy and efficiency.
OnlineAugment: Online Data Augmentation with Less Domain Knowledge
First is that most if not all modern augmentation search methods are offline and learning policies are isolated from their usage.
Causal Feature Selection for Algorithmic Fairness
In this work, we consider fairness in the integration component of data management, aiming to identify features that improve prediction without adding any bias to the dataset.
Calibrating Healthcare AI: Towards Reliable and Interpretable Deep Predictive Models
The wide-spread adoption of representation learning technologies in clinical decision making strongly emphasizes the need for characterizing model reliability and enabling rigorous introspection of model behavior.
StarNet: towards Weakly Supervised Few-Shot Object Detection
Few-shot detection and classification have advanced significantly in recent years.
TAFSSL: Task-Adaptive Feature Sub-Space Learning for few-shot classification
The field of Few-Shot Learning (FSL), or learning from very few (typically $1$ or $5$) examples per novel class (unseen during training), has received a lot of attention and significant performance advances in the recent literature.
Calibrate and Prune: Improving Reliability of Lottery Tickets Through Prediction Calibration
The hypothesis that sub-network initializations (lottery) exist within the initializations of over-parameterized networks, which when trained in isolation produce highly generalizable models, has led to crucial insights into network initialization and has enabled efficient inferencing.
CZ-GEM: A FRAMEWORK FOR DISENTANGLED REPRESENTATION LEARNING
In this work, we tackle a slightly more intricate scenario where the observations are generated from a conditional distribution of some known control variate and some latent noise variate.
Learning New Tricks From Old Dogs: Multi-Source Transfer Learning From Pre-Trained Networks
However, for practical, privacy, or other reasons, in a variety of applications we may have no control over the individual source task training, nor access to source training samples.
Drug Repurposing for Cancer: An NLP Approach to Identify Low-Cost Therapies
More than 200 generic drugs approved by the U. S. Food and Drug Administration for non-cancer indications have shown promise for treating cancer.
Estimating Skin Tone and Effects on Classification Performance in Dermatology Datasets
We find that the majority of the data in the the two datasets have ITA values between 34. 5{\deg} and 48{\deg}, which are associated with lighter skin, and is consistent with under-representation of darker skinned populations in these datasets.
Optimizing Loss Landscape Connectivity via Neuron Alignment
Empirically, this initialization is critical for efficiently learning a simple, planar, low-loss curve between networks that successfully generalizes.
Building Calibrated Deep Models via Uncertainty Matching with Auxiliary Interval Predictors
With rapid adoption of deep learning in critical applications, the question of when and how much to trust these models often arises, which drives the need to quantify the inherent uncertainties.
One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques
Equally important, we provide a taxonomy to help entities requiring explanations to navigate the space of explanation methods, not only those in the toolkit but also in the broader literature on explainability.
Leveraging Latent Features for Local Explanations
As the application of deep neural networks proliferates in numerous areas such as medical imaging, video surveillance, and self driving cars, the need for explaining the decisions of these models has become a hot research topic, both at the global and local level.
Understanding Unequal Gender Classification Accuracy from Face Images
Recent work shows unequal performance of commercial face classification services in the gender classification task across intersectional groups defined by skin type and gender.
Co-regularized Alignment for Unsupervised Domain Adaptation
Deep neural networks, trained with large amount of labeled data, can fail to generalize well when tested with examples from a \emph{target domain} whose distribution differs from the training data distribution, referred as the \emph{source domain}.
AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Bias
Such architectural design and abstractions enable researchers and developers to extend the toolkit with their new algorithms and improvements, and to use it for performance benchmarking.
Understanding Behavior of Clinical Models under Domain Shifts
The hypothesis that computational models can be reliable enough to be adopted in prognosis and patient care is revolutionizing healthcare.
Fairness GAN
In this paper, we introduce the Fairness GAN, an approach for generating a dataset that is plausibly similar to a given multimedia dataset, but is more fair with respect to protected attributes in allocative decision making.
Optimizing Kernel Machines using Deep Learning
To this end, we develop the DKMO (Deep Kernel Machine Optimization) framework, that creates an ensemble of dense embeddings using Nystrom kernel approximations and utilizes deep learning to generate task-specific representations through the fusion of the embeddings.
Variational Inference of Disentangled Latent Concepts from Unlabeled Observations
Disentangled representations, where the higher level data generative factors are reflected in disjoint latent dimensions, offer several benefits such as ease of deriving invariant representations, transferability to other tasks, interpretability, etc.
Semi-supervised Learning with GANs: Manifold Invariance with Improved Inference
Semi-supervised learning methods using Generative Adversarial Networks (GANs) have shown promising empirical success recently.
A Deep Learning Approach To Multiple Kernel Fusion
Kernel fusion is a popular and effective approach for combining multiple features that characterize different aspects of data.
Robust Local Scaling using Conditional Quantiles of Graph Similarities
In this paper, we propose the use of quantile analysis to obtain local scale estimates for neighborhood graph construction.
TreeView: Peeking into Deep Neural Networks Via Feature-Space Partitioning
In this paper, we take a step in the direction of tackling the problem of interpretability without compromising the model accuracy.
Understanding Innovation to Drive Sustainable Development
Innovation is among the key factors driving a country's economic and social growth.
