Search Results for author:
Found 69 papers, 19 papers with code
Strategic Demonstration Selection for Improved Fairness in LLM In-Context Learning
Recent studies highlight the effectiveness of using in-context learning (ICL) to steer large language models (LLMs) in processing tabular data, a challenging task given the structured nature of such data.
LawLLM: Law Large Language Model for the US Legal System
Moreover, the subtle distinctions between similar and precedent cases require a deep understanding of legal knowledge.
When AI Meets Finance (StockAgent): Large Language Model-based Stock Trading in Simulated Real-world Environments
The StockAgent allows users to evaluate the impact of different external factors on investor trading and to analyze trading behavior and profitability effects.
When Search Engine Services meet Large Language Models: Visions and Challenges
Combining Large Language Models (LLMs) with search engine services marks a significant shift in the field of services computing, opening up new possibilities to enhance how we search for and retrieve information, understand content, and interact with internet services.
Towards Imperceptible Backdoor Attack in Self-supervised Learning
In this paper, we propose an imperceptible and effective backdoor attack against self-supervised models.
Neural Operator for Accelerating Coronal Magnetic Field Model
Studying the sun's outer atmosphere is challenging due to its complex magnetic fields impacting solar activities.
Quantifying Multilingual Performance of Large Language Models Across Languages
Besides, the experiments show that there is a strong correlation between the LLM's performance in different languages and the proportion of those languages in its pre-training corpus.
Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers?
In this paper, we explore the hypothesis that LLMs process concepts of varying complexities in different layers, introducing the idea of "Concept Depth" to suggest that more complex concepts are typically acquired in deeper layers.
ProLLM: Protein Chain-of-Thoughts Enhanced LLM for Protein-Protein Interaction Prediction
Specifically, we propose Protein Chain of Thought (ProCoT), which replicates the biological mechanism of signaling pathways as natural language prompts.
Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Era
Therefore, in this paper, we introduce Usable XAI in the context of LLMs by analyzing (1) how XAI can benefit LLMs and AI systems, and (2) how LLMs can contribute to the advancement of XAI.
Knowledge Graph Large Language Model (KG-LLM) for Link Prediction
We first convert structured knowledge graph data into natural language and then use these natural language prompts to fine-tune LLMs to enhance multi-hop link prediction in KGs.
What if LLMs Have Different World Views: Simulating Alien Civilizations with LLM-based Agents
In this study, we introduce "CosmoAgent," an innovative artificial intelligence framework utilizing Large Language Models (LLMs) to simulate complex interactions between human and extraterrestrial civilizations, with a special emphasis on Stephen Hawking's cautionary advice about not sending radio signals haphazardly into the universe.
Towards Uncovering How Large Language Model Works: An Explainability Perspective
Large language models (LLMs) have led to breakthroughs in language tasks, yet the internal mechanisms that enable their remarkable generalization and reasoning abilities remain opaque.
Time Series Forecasting with LLMs: Understanding and Enhancing Model Capabilities
Large language models (LLMs) have been applied in many fields and have developed rapidly in recent years.
FaithLM: Towards Faithful Explanations for Large Language Models
Large Language Models (LLMs) have become proficient in addressing complex tasks by leveraging their extensive internal knowledge and reasoning capabilities.
Health-LLM: Personalized Retrieval-Augmented Disease Prediction System
Compared to traditional health management applications, our system has three main advantages: (1) It integrates health reports and medical knowledge into a large model to ask relevant questions to large language model for disease prediction; (2) It leverages a retrieval augmented generation (RAG) mechanism to enhance feature extraction; (3) It incorporates a semi-automated feature updating framework that can merge and delete features to improve accuracy of disease prediction.
DataFrame QA: A Universal LLM Framework on DataFrame Question Answering Without Data Exposure
This paper introduces DataFrame question answering (QA), a novel task that utilizes large language models (LLMs) to generate Pandas queries for information retrieval and data analysis on dataframes, emphasizing safe and non-revealing data handling.
Explanations of Classifiers Enhance Medical Image Segmentation via End-to-end Pre-training
Based on a large-scale medical image classification dataset, our work collects explanations from well-trained classifiers to generate pseudo labels of segmentation tasks.
Explaining Time Series via Contrastive and Locally Sparse Perturbations
Explaining multivariate time series is a compound challenge, as it requires identifying important locations in the time series and matching complex temporal patterns.
The Impact of Reasoning Step Length on Large Language Models
Alternatively, shortening the reasoning steps, even while preserving the key information, significantly diminishes the reasoning abilities of models.
Towards Explainable Artificial Intelligence (XAI): A Data Mining Perspective
Given the complexity and lack of transparency in deep neural networks (DNNs), extensive efforts have been made to make these systems more interpretable or explain their behaviors in accessible terms.
TVE: Learning Meta-attribution for Transferable Vision Explainer
This meta-attribution leverages the versatility of generic backbone encoders to comprehensively encode the attribution knowledge for the input instance, which enables TVE to seamlessly transfer to explain various downstream tasks, without the need for training on task-specific data.
A Theoretical Approach to Characterize the Accuracy-Fairness Trade-off Pareto Frontier
While the accuracy-fairness trade-off has been frequently observed in the literature of fair machine learning, rigorous theoretical analyses have been scarce.
Mitigating Shortcuts in Language Models with Soft Label Encoding
Recent research has shown that large language models rely on spurious correlations in the data for natural language understanding (NLU) tasks.
Natural Language Understanding
Out-of-Distribution Generalization
Boosting Fair Classifier Generalization through Adaptive Priority Reweighing
Our adaptive reweighing method prioritizes samples closer to the decision boundary and assigns a higher weight to improve the generalizability of fair classifiers.
Explainability for Large Language Models: A Survey
For each paradigm, we summarize the goals and dominant approaches for generating local explanations of individual predictions and global explanations of overall model knowledge.
A Survey on Fairness in Large Language Models
Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world.
XGBD: Explanation-Guided Graph Backdoor Detection
An emerging detection strategy in the vision and NLP domains is based on an intriguing phenomenon: when training models on a mixture of backdoor and clean samples, the loss on backdoor samples drops significantly faster than on clean samples, allowing backdoor samples to be easily detected by selecting samples with the lowest loss values.
DISPEL: Domain Generalization via Domain-Specific Liberating
Domain generalization aims to learn a generalization model that can perform well on unseen test domains by only training on limited source domains.
Prompt Tuning Pushes Farther, Contrastive Learning Pulls Closer: A Two-Stage Approach to Mitigate Social Biases
Meanwhile, experimental results on the GLUE benchmark show that CCPA retains the language modeling capability of PLMs.
FAIRER: Fairness as Decision Rationale Alignment
Existing fairness regularization terms fail to achieve decision rationale alignment because they only constrain last-layer outputs while ignoring intermediate neuron alignment.
DEGREE: Decomposition Based Explanation For Graph Neural Networks
Graph Neural Networks (GNNs) are gaining extensive attention for their application in graph data.
Black-box Backdoor Defense via Zero-shot Image Purification
Defending against such attacks is challenging, especially for real-world black-box models where only query access is permitted.
On Model Compression for Neural Networks: Framework, Algorithm, and Convergence Guarantee
This paper focuses on two model compression techniques: low-rank approximation and weight pruning in neural networks, which are very popular nowadays.
Understanding and Unifying Fourteen Attribution Methods with Taylor Interactions
Various attribution methods have been developed to explain deep neural networks (DNNs) by inferring the attribution/importance/contribution score of each input variable to the final output.
Efficient XAI Techniques: A Taxonomic Survey
Finally, we summarize the challenges of deploying XAI acceleration methods to real-world scenarios, overcoming the trade-off between faithfulness and efficiency, and the selection of different acceleration methods.
Explainable artificial intelligence
Explainable Artificial Intelligence (XAI)
Mitigating Relational Bias on Knowledge Graphs
Knowledge graph data are prevalent in real-world applications, and knowledge graph neural networks (KGNNs) are essential techniques for knowledge graph representation learning.
Shortcut Learning of Large Language Models in Natural Language Understanding
We first introduce the concepts of shortcut learning of language models.
Mitigating Algorithmic Bias with Limited Annotations
Existing work on fairness modeling commonly assumes that sensitive attributes for all instances are fully available, which may not be true in many real-world applications due to the high cost of acquiring sensitive information.
Fair Machine Learning in Healthcare: A Review
The digitization of healthcare data coupled with advances in computational capabilities has propelled the adoption of machine learning (ML) in healthcare.
Accelerating Shapley Explanation via Contributive Cooperator Selection
Even though Shapley value provides an effective explanation for a DNN model prediction, the computation relies on the enumeration of all possible input feature coalitions, which leads to the exponentially growing complexity.
Unveiling Project-Specific Bias in Neural Code Models
We propose a Cond-Idf measurement to interpret this behavior, which quantifies the relatedness of a token with a label and its project-specificness.
Robustness Challenges in Model Distillation and Pruning for Natural Language Understanding
Recent work has focused on compressing pre-trained language models (PLMs) like BERT where the major focus has been to improve the in-distribution performance for downstream tasks.
Was my Model Stolen? Feature Sharing for Robust and Transferable Watermarks
The main idea is to insert a watermark which is only known to defender into the protected model and the watermark will then be transferred into all stolen models.
Fairness via Representation Neutralization
This process not only requires a lot of instance-level annotations for sensitive attributes, it also does not guarantee that all fairness sensitive information has been removed from the encoder.
A General Taylor Framework for Unifying and Revisiting Attribution Methods
However, the attribution problem has not been well-defined, which lacks a unified guideline to the contribution assignment process.
Learning Disentangled Representations for Time Series
Motivated by the success of disentangled representation learning in computer vision, we study the possibility of learning semantic-rich time-series representations, which remains unexplored due to three main challenges: 1) sequential data structure introduces complex temporal correlations and makes the latent representations hard to interpret, 2) sequential models suffer from KL vanishing problem, and 3) interpretable semantic concepts for time-series often rely on multiple factors instead of individuals.
Mutual Information Preserving Back-propagation: Learn to Invert for Faithful Attribution
The basic idea is to learn a source signal by back-propagation such that the mutual information between input and output should be as much as possible preserved in the mutual information between input and the source signal.
Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Models
These two observations are further employed to formulate a measurement which can quantify the shortcut degree of each training sample.
Generative Counterfactuals for Neural Networks via Attribute-Informed Perturbation
With the wide use of deep neural networks (DNN), model interpretability has become a critical concern, since explainable decisions are preferred in high-stake scenarios.
Deep Serial Number: Computational Watermarking for DNN Intellectual Property Protection
In this paper, we present DSN (Deep Serial Number), a simple yet effective watermarking algorithm designed specifically for deep neural networks (DNNs).
A Unified Taylor Framework for Revisiting Attribution Methods
Attribution methods have been developed to understand the decision-making process of machine learning models, especially deep neural networks, by assigning importance scores to individual features.
Machine Learning Explanations to Prevent Overtrust in Fake News Detection
Combating fake news and misinformation propagation is a challenging task in the post-truth era.
Mitigating Gender Bias in Captioning Systems
Image captioning has made substantial progress with huge supporting image collections sourced from the web.
An Embarrassingly Simple Approach for Trojan Attack in Deep Neural Networks
In this paper, we investigate a specific security problem called trojan attack, which aims to attack deployed DNN systems relying on the hidden trigger patterns inserted by malicious hackers.
Adversarial Attacks and Defenses: An Interpretation Perspective
In this paper, we review recent work on adversarial attacks and defenses, particularly from the perspective of machine learning interpretation.
Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks
Recently, increasing attention has been drawn to the internal mechanisms of convolutional neural networks, and the reason why the network makes specific decisions.
Ranked #2 on
Error Understanding
on CUB-200-2011 (ResNet-101)
Sub-Architecture Ensemble Pruning in Neural Architecture Search
Neural architecture search (NAS) is gaining more and more attention in recent years due to its flexibility and remarkable capability to reduce the burden of neural network design.
Distribution-Guided Local Explanation for Black-Box Classifiers
Existing local explanation methods provide an explanation for each decision of black-box classifiers, in the form of relevance scores of features according to their contributions.
Towards Generalizable Deepfake Detection with Locality-aware AutoEncoder
The analysis further shows that LAE outperforms the state-of-the-arts by 6. 52%, 12. 03%, and 3. 08% respectively on three deepfake detection tasks in terms of generalization accuracy on previously unseen manipulations.
Fairness in Deep Learning: A Computational Perspective
Deep learning is increasingly being used in high-stake decision making applications that affect individual lives.
Learning Credible Deep Neural Networks with Rationale Regularization
Recent explainability related studies have shown that state-of-the-art DNNs do not always adopt correct evidences to make decisions.
SpecAE: Spectral AutoEncoder for Anomaly Detection in Attributed Networks
SpecAE leverages Laplacian sharpening to amplify the distances between representations of anomalies and the ones of the majority.
Deep Structured Cross-Modal Anomaly Detection
To this end, we propose a novel deep structured anomaly detection framework to identify the cross-modal anomalies embedded in the data.
Evaluating Explanation Without Ground Truth in Interpretable Machine Learning
Interpretable Machine Learning (IML) has become increasingly important in many real-world applications, such as autonomous cars and medical diagnosis, where explanations are significantly preferred to help people better understand how machine learning systems work and further enhance their trust towards systems.
BIG-bench Machine Learning
Interpretable Machine Learning
+1
XFake: Explainable Fake News Detector with Visualizations
In this demo paper, we present the XFake system, an explainable fake news detector that assists end-users to identify news credibility.
On Attribution of Recurrent Neural Network Predictions via Additive Decomposition
REAT decomposes the final prediction of a RNN into additive contribution of each word in the input text.
Techniques for Interpretable Machine Learning
Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision.
Towards Explanation of DNN-based Prediction with Guided Feature Inversion
While deep neural networks (DNN) have become an effective computational tool, the prediction results are often criticized by the lack of interpretability, which is essential in many real-world applications such as health informatics.
