Search Results for author:
Found 60 papers, 14 papers with code
Towards Explanation of DNN-based Prediction with Guided Feature Inversion
While deep neural networks (DNN) have become an effective computational tool, the prediction results are often criticized by the lack of interpretability, which is essential in many real-world applications such as health informatics.
Techniques for Interpretable Machine Learning
Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision.
On Attribution of Recurrent Neural Network Predictions via Additive Decomposition
REAT decomposes the final prediction of a RNN into additive contribution of each word in the input text.
XFake: Explainable Fake News Detector with Visualizations
In this demo paper, we present the XFake system, an explainable fake news detector that assists end-users to identify news credibility.
Evaluating Explanation Without Ground Truth in Interpretable Machine Learning
Interpretable Machine Learning (IML) has become increasingly important in many real-world applications, such as autonomous cars and medical diagnosis, where explanations are significantly preferred to help people better understand how machine learning systems work and further enhance their trust towards systems.
BIG-bench Machine Learning
Interpretable Machine Learning
+1
SpecAE: Spectral AutoEncoder for Anomaly Detection in Attributed Networks
SpecAE leverages Laplacian sharpening to amplify the distances between representations of anomalies and the ones of the majority.
Deep Structured Cross-Modal Anomaly Detection
To this end, we propose a novel deep structured anomaly detection framework to identify the cross-modal anomalies embedded in the data.
Learning Credible Deep Neural Networks with Rationale Regularization
Recent explainability related studies have shown that state-of-the-art DNNs do not always adopt correct evidences to make decisions.
Fairness in Deep Learning: A Computational Perspective
Deep learning is increasingly being used in high-stake decision making applications that affect individual lives.
Towards Generalizable Deepfake Detection with Locality-aware AutoEncoder
The analysis further shows that LAE outperforms the state-of-the-arts by 6. 52%, 12. 03%, and 3. 08% respectively on three deepfake detection tasks in terms of generalization accuracy on previously unseen manipulations.
Distribution-Guided Local Explanation for Black-Box Classifiers
Existing local explanation methods provide an explanation for each decision of black-box classifiers, in the form of relevance scores of features according to their contributions.
Sub-Architecture Ensemble Pruning in Neural Architecture Search
Neural architecture search (NAS) is gaining more and more attention in recent years due to its flexibility and remarkable capability to reduce the burden of neural network design.
Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks
Recently, increasing attention has been drawn to the internal mechanisms of convolutional neural networks, and the reason why the network makes specific decisions.
Adversarial Attacks and Defenses: An Interpretation Perspective
In this paper, we review recent work on adversarial attacks and defenses, particularly from the perspective of machine learning interpretation.
Mitigating Gender Bias in Captioning Systems
Image captioning has made substantial progress with huge supporting image collections sourced from the web.
An Embarrassingly Simple Approach for Trojan Attack in Deep Neural Networks
In this paper, we investigate a specific security problem called trojan attack, which aims to attack deployed DNN systems relying on the hidden trigger patterns inserted by malicious hackers.
Machine Learning Explanations to Prevent Overtrust in Fake News Detection
Combating fake news and misinformation propagation is a challenging task in the post-truth era.
A Unified Taylor Framework for Revisiting Attribution Methods
Attribution methods have been developed to understand the decision-making process of machine learning models, especially deep neural networks, by assigning importance scores to individual features.
Deep Serial Number: Computational Watermarking for DNN Intellectual Property Protection
In this paper, we present DSN (Deep Serial Number), a simple yet effective watermarking algorithm designed specifically for deep neural networks (DNNs).
Generative Counterfactuals for Neural Networks via Attribute-Informed Perturbation
With the wide use of deep neural networks (DNN), model interpretability has become a critical concern, since explainable decisions are preferred in high-stake scenarios.
Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Models
These two observations are further employed to formulate a measurement which can quantify the shortcut degree of each training sample.
Mutual Information Preserving Back-propagation: Learn to Invert for Faithful Attribution
The basic idea is to learn a source signal by back-propagation such that the mutual information between input and output should be as much as possible preserved in the mutual information between input and the source signal.
Learning Disentangled Representations for Time Series
Motivated by the success of disentangled representation learning in computer vision, we study the possibility of learning semantic-rich time-series representations, which remains unexplored due to three main challenges: 1) sequential data structure introduces complex temporal correlations and makes the latent representations hard to interpret, 2) sequential models suffer from KL vanishing problem, and 3) interpretable semantic concepts for time-series often rely on multiple factors instead of individuals.
A General Taylor Framework for Unifying and Revisiting Attribution Methods
However, the attribution problem has not been well-defined, which lacks a unified guideline to the contribution assignment process.
Fairness via Representation Neutralization
This process not only requires a lot of instance-level annotations for sensitive attributes, it also does not guarantee that all fairness sensitive information has been removed from the encoder.
Was my Model Stolen? Feature Sharing for Robust and Transferable Watermarks
The main idea is to insert a watermark which is only known to defender into the protected model and the watermark will then be transferred into all stolen models.
Robustness Challenges in Model Distillation and Pruning for Natural Language Understanding
Recent work has focused on compressing pre-trained language models (PLMs) like BERT where the major focus has been to improve the in-distribution performance for downstream tasks.
Unveiling Project-Specific Bias in Neural Code Models
We propose a Cond-Idf measurement to interpret this behavior, which quantifies the relatedness of a token with a label and its project-specificness.
Accelerating Shapley Explanation via Contributive Cooperator Selection
Even though Shapley value provides an effective explanation for a DNN model prediction, the computation relies on the enumeration of all possible input feature coalitions, which leads to the exponentially growing complexity.
Fair Machine Learning in Healthcare: A Review
The digitization of healthcare data coupled with advances in computational capabilities has propelled the adoption of machine learning (ML) in healthcare.
Mitigating Algorithmic Bias with Limited Annotations
Existing work on fairness modeling commonly assumes that sensitive attributes for all instances are fully available, which may not be true in many real-world applications due to the high cost of acquiring sensitive information.
Shortcut Learning of Large Language Models in Natural Language Understanding
We first introduce the concepts of shortcut learning of language models.
Mitigating Relational Bias on Knowledge Graphs
Knowledge graph data are prevalent in real-world applications, and knowledge graph neural networks (KGNNs) are essential techniques for knowledge graph representation learning.
Efficient XAI Techniques: A Taxonomic Survey
Finally, we summarize the challenges of deploying XAI acceleration methods to real-world scenarios, overcoming the trade-off between faithfulness and efficiency, and the selection of different acceleration methods.
Explainable artificial intelligence
Explainable Artificial Intelligence (XAI)
Understanding and Unifying Fourteen Attribution Methods with Taylor Interactions
Various attribution methods have been developed to explain deep neural networks (DNNs) by inferring the attribution/importance/contribution score of each input variable to the final output.
DEGREE: Decomposition Based Explanation For Graph Neural Networks
Graph Neural Networks (GNNs) are gaining extensive attention for their application in graph data.
FAIRER: Fairness as Decision Rationale Alignment
Existing fairness regularization terms fail to achieve decision rationale alignment because they only constrain last-layer outputs while ignoring intermediate neuron alignment.
Prompt Tuning Pushes Farther, Contrastive Learning Pulls Closer: A Two-Stage Approach to Mitigate Social Biases
Meanwhile, experimental results on the GLUE benchmark show that CCPA retains the language modeling capability of PLMs.
DISPEL: Domain Generalization via Domain-Specific Liberating
Domain generalization aims to learn a generalization model that can perform well on unseen test domains by only training on limited source domains.
XGBD: Explanation-Guided Graph Backdoor Detection
An emerging detection strategy in the vision and NLP domains is based on an intriguing phenomenon: when training models on a mixture of backdoor and clean samples, the loss on backdoor samples drops significantly faster than on clean samples, allowing backdoor samples to be easily detected by selecting samples with the lowest loss values.
A Survey on Fairness in Large Language Models
Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world.
Explainability for Large Language Models: A Survey
For each paradigm, we summarize the goals and dominant approaches for generating local explanations of individual predictions and global explanations of overall model knowledge.
Boosting Fair Classifier Generalization through Adaptive Priority Reweighing
Our adaptive reweighing method prioritizes samples closer to the decision boundary and assigns a higher weight to improve the generalizability of fair classifiers.
Mitigating Shortcuts in Language Models with Soft Label Encoding
Recent research has shown that large language models rely on spurious correlations in the data for natural language understanding (NLU) tasks.
Natural Language Understanding
Out-of-Distribution Generalization
A Theoretical Approach to Characterize the Accuracy-Fairness Trade-off Pareto Frontier
While the accuracy-fairness trade-off has been frequently observed in the literature of fair machine learning, rigorous theoretical analyses have been scarce.
LETA: Learning Transferable Attribution for Generic Vision Explainer
To address this problem, we develop a pre-trained, DNN-based, generic explainer on large-scale image datasets, and leverage its transferability to explain various vision models for downstream tasks.
Towards Explainable Artificial Intelligence (XAI): A Data Mining Perspective
Given the complexity and lack of transparency in deep neural networks (DNNs), extensive efforts have been made to make these systems more interpretable or explain their behaviors in accessible terms.
The Impact of Reasoning Step Length on Large Language Models
Alternatively, shortening the reasoning steps, even while preserving the key information, significantly diminishes the reasoning abilities of models.
Explanations of Classifiers Enhance Medical Image Segmentation via End-to-end Pre-training
Based on a large-scale medical image classification dataset, our work collects explanations from well-trained classifiers to generate pseudo labels of segmentation tasks.
Explaining Time Series via Contrastive and Locally Sparse Perturbations
Explaining multivariate time series is a compound challenge, as it requires identifying important locations in the time series and matching complex temporal patterns.
DataFrame QA: A Universal LLM Framework on DataFrame Question Answering Without Data Exposure
This paper introduces DataFrame question answering (QA), a novel task that utilizes large language models (LLMs) to generate Pandas queries for information retrieval and data analysis on dataframes, emphasizing safe and non-revealing data handling.
Health-LLM: Personalized Retrieval-Augmented Disease Prediction System
Compared to traditional health management applications, our system has three main advantages: (1) It integrates health reports and medical knowledge into a large model to ask relevant questions to large language model for disease prediction; (2) It leverages a retrieval augmented generation (RAG) mechanism to enhance feature extraction; (3) It incorporates a semi-automated feature updating framework that can merge and delete features to improve accuracy of disease prediction.
Large Language Models As Faithful Explainers
In this work, we introduce a generative explanation framework, xLLM, to improve the faithfulness of the explanations provided in natural language formats for LLMs.
Time Series Forecasting with LLMs: Understanding and Enhancing Model Capabilities
However, there is a research gap in the LLMs' preferences in this field.
Towards Uncovering How Large Language Model Works: An Explainability Perspective
Large language models (LLMs) have led to breakthroughs in language tasks, yet the internal mechanisms that enable their remarkable generalization and reasoning abilities remain opaque.
What if LLMs Have Different World Views: Simulating Alien Civilizations with LLM-based Agents
In this study, we introduce "CosmoAgent," an innovative artificial intelligence framework utilizing Large Language Models (LLMs) to simulate complex interactions between human and extraterrestrial civilizations, with a special emphasis on Stephen Hawking's cautionary advice about not sending radio signals haphazardly into the universe.
Knowledge Graph Large Language Model (KG-LLM) for Link Prediction
The task of predicting multiple links within knowledge graphs (KGs) stands as a challenge in the field of knowledge graph analysis, a challenge increasingly resolvable due to advancements in natural language processing (NLP) and KG embedding techniques.
Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Era
Therefore, in this paper, we introduce Usable XAI in the context of LLMs by analyzing (1) how XAI can benefit LLMs and AI systems, and (2) how LLMs can contribute to the advancement of XAI.
Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers?
We employ a probing technique to extract representations from different layers of the model and apply these to classification tasks.
Quantifying Multilingual Performance of Large Language Models Across Languages
However, currently there is no work to quantitatively measure the performance of LLMs in low-resource languages.
