Search Results for author:
Found 35 papers, 21 papers with code
Dual-Path Distillation: A Unified Framework to Improve Black-Box Attacks
To obtain sufficient knowledge for crafting adversarial examples, previous methods query the target model with inputs that are perturbed with different searching directions.
Enhancing Target-unspecific Tasks through a Features Matrix
Recent developments in prompt learning of large vision-language models have significantly improved performance in target-specific tasks.
Leveraging Submodule Linearity Enhances Task Arithmetic Performance in LLMs
Task arithmetic is a straightforward yet highly effective strategy for model merging, enabling the resultant model to exhibit multi-task capabilities.
Generalizable Prompt Learning of CLIP: A Brief Overview
Existing vision-language models (VLMs) such as CLIP have showcased an impressive capability to generalize well across various downstream tasks.
Detecting Discrepancies Between AI-Generated and Natural Images Using Uncertainty
In this work, we propose a novel approach for detecting AI-generated images by leveraging predictive uncertainty to mitigate misuse and associated risks.
Enhancing Multiple Dimensions of Trustworthiness in LLMs via Sparse Activation Control
This technique leverages semantic features to control the representation of LLM's intermediate hidden states, enabling the model to meet specific requirements such as increased honesty or heightened safety awareness.
FuseFL: One-Shot Federated Learning through the Lens of Causality with Progressive Model Fusion
In this work, we provide a causal view to find that this performance drop of OFL methods comes from the isolation problem, which means that local isolatedly trained models in OFL may easily fit to spurious correlations due to the data heterogeneity.
Interpreting and Improving Large Language Models in Arithmetic Calculation
In this work, we delve into uncovering a specific mechanism by which LLMs execute calculations.
From Yes-Men to Truth-Tellers: Addressing Sycophancy in Large Language Models with Pinpoint Tuning
Recent works propose to employ supervised fine-tuning (SFT) to mitigate the sycophancy issue, while it typically leads to the degeneration of LLMs' general capability.
SpectralKAN: Kolmogorov-Arnold Network for Hyperspectral Images Change Detection
In this paper, we propose an spectral Kolmogorov-Arnold Network for HSIs-CD (SpectralKAN).
MOS: Model Synergy for Test-Time Adaptation on LiDAR-Based 3D Object Detection
Specifically, we propose a Model Synergy (MOS) strategy that dynamically selects historical checkpoints with diverse knowledge and assembles them to best accommodate the current test batch.
A 7K Parameter Model for Underwater Image Enhancement based on Transmission Map Prior
Although deep learning based models for underwater image enhancement have achieved good performance, they face limitations in both lightweight and effectiveness, which prevents their deployment and application on resource-constrained platforms.
NoiseDiffusion: Correcting Noise for Image Interpolation with Diffusion Models beyond Spherical Linear Interpolation
Hence, NoiseDiffusion performs interpolation within the noisy image space and injects raw images into these noisy counterparts to address the challenge of information loss.
ConjNorm: Tractable Density Estimation for Out-of-Distribution Detection
Extensive experiments across OOD detection benchmarks empirically demonstrate that our proposed \textsc{ConjNorm} has established a new state-of-the-art in a variety of OOD detection setups, outperforming the current best method by up to 13. 25$\%$ and 28. 19$\%$ (FPR95) on CIFAR-100 and ImageNet-1K, respectively.
Enhancing One-Shot Federated Learning Through Data and Ensemble Co-Boosting
These hard samples are then employed to promote the quality of the ensemble model by adjusting the ensembling weights for each client model.
Robust Training of Federated Models with Extremely Label Deficiency
Federated semi-supervised learning (FSSL) has emerged as a powerful paradigm for collaboratively training machine learning models using distributed data with label deficiency.
FedImpro: Measuring and Improving Client Update in Federated Learning
First, we analyze the generalization contribution of local training and conclude that this generalization contribution is bounded by the conditional Wasserstein distance between the data distribution of different clients.
Federated Learning with Extremely Noisy Clients via Negative Distillation
The model trained on noisy labels serves as a `bad teacher' in knowledge distillation, aiming to decrease the risk of providing incorrect information.
Learning to Augment Distributions for Out-of-Distribution Detection
Accordingly, we propose Distributional-Augmented OOD Learning (DAL), alleviating the OOD distribution discrepancy by crafting an OOD distribution set that contains all distributions in a Wasserstein ball centered on the auxiliary OOD distribution.
Continual Named Entity Recognition without Catastrophic Forgetting
This issue is intensified in CNER due to the consolidation of old entity types from previous steps into the non-entity type at each step, leading to what is known as the semantic shift problem of the non-entity type.
Continual Named Entity Recognition
named-entity-recognition
+1
FedFed: Feature Distillation against Data Heterogeneity in Federated Learning
Comprehensive experiments demonstrate the efficacy of FedFed in promoting model performance.
Invariant Learning via Probability of Sufficient and Necessary Causes
To capture the information of sufficient and necessary causes, we employ a classical concept, the probability of sufficiency and necessary causes (PNS), which indicates the probability of whether one is the necessary and sufficient cause.
Moderately Distributional Exploration for Domain Generalization
We show that MODE can endow models with provable generalization performance on unknown target domains.
Hard Sample Matters a Lot in Zero-Shot Quantization
Nonetheless, we find that the synthetic samples constructed in existing ZSQ methods can be easily fitted by models.
FedML Parrot: A Scalable Federated Learning System via Heterogeneity-aware Scheduling on Sequential and Hierarchical Training
It improves the training efficiency, remarkably relaxes the requirements on the hardware, and supports efficient large-scale FL experiments with stateful clients by: (1) sequential training clients on devices; (2) decomposing original aggregation into local and global aggregation on devices and server respectively; (3) scheduling tasks to mitigate straggler problems and enhance computing utility; (4) distributed client state manager to support various FL algorithms.
Watermarking for Out-of-distribution Detection
Out-of-distribution (OOD) detection aims to identify OOD data based on representations extracted from well-trained deep models.
Ranked #21 on
Out-of-Distribution Detection
on ImageNet-1k vs Places
Towards Lightweight Black-Box Attacks against Deep Neural Networks
As it is hard to mitigate the approximation error with few available samples, we propose Error TransFormer (ETF) for lightweight attacks.
Pareto Invariant Risk Minimization: Towards Mitigating the Optimization Dilemma in Out-of-Distribution Generalization
Recently, there has been a growing surge of interest in enabling machine learning systems to generalize well to Out-of-Distribution (OOD) data.
Virtual Homogeneity Learning: Defending against Data Heterogeneity in Federated Learning
In federated learning (FL), model performance typically suffers from client drift induced by data heterogeneity, and mainstream works focus on correcting client drift.
Prompt Distribution Learning
We present prompt distribution learning for effectively adapting a pre-trained vision-language model to address downstream recognition tasks.
Understanding and Improving Graph Injection Attack by Promoting Unnoticeability
Recently Graph Injection Attack (GIA) emerges as a practical attack scenario on Graph Neural Networks (GNNs), where the adversary can merely inject few malicious nodes instead of modifying existing nodes or edges, i. e., Graph Modification Attack (GMA).
Learning Causally Invariant Representations for Out-of-Distribution Generalization on Graphs
Despite recent success in using the invariance principle for out-of-distribution (OOD) generalization on Euclidean data (e. g., images), studies on graph data are still limited.
Meta Convolutional Neural Networks for Single Domain Generalization
Taking meta features as reference, we propose compositional operations to eliminate irrelevant features of local convolutional features by an addressing process and then to reformulate the convolutional feature maps as a composition of related meta features.
Ranked #5 on
Single-Source Domain Generalization
on Digits-five
Class-Disentanglement and Applications in Adversarial Detection and Defense
In this paper, we propose ''class-disentanglement'' that trains a variational autoencoder $G(\cdot)$ to extract this class-dependent information as $x - G(x)$ via a trade-off between reconstructing $x$ by $G(x)$ and classifying $x$ by $D(x-G(x))$, where the former competes with the latter in decomposing $x$ so the latter retains only necessary information for classification in $x-G(x)$.
CausalAdv: Adversarial Robustness through the Lens of Causality
The adversarial vulnerability of deep neural networks has attracted significant attention in machine learning.
