Search Results for author:
Found 41 papers, 9 papers with code
Generating, Fast and Slow: Scalable Parallel Video Generation with Video Interface Networks
At each diffusion step, VINs encode global semantics from the noisy input of local chunks and the encoded representations, in turn, guide DiTs in denoising chunks in parallel.
Layer- and Timestep-Adaptive Differentiable Token Compression Ratios for Efficient Diffusion Transformers
To address this, we propose DiffRatio-MoD, a dynamic DiT inference framework with differentiable compression ratios, which automatically learns to dynamically route computation across layers and timesteps for each image token, resulting in Mixture-of-Depths (MoD) efficient DiT models.
DOLLAR: Few-Step Video Generation via Distillation and Latent Reward Optimization
In this work, we introduce a distillation method that combines variational score distillation and consistency distillation to achieve few-step video generation, maintaining both high quality and diversity.
FedCoLLM: A Parameter-Efficient Federated Co-tuning Framework for Large and Small Language Models
By adapting Large Language Models (LLMs) to domain-specific tasks or enriching them with domain-specific knowledge, we can fully harness the capabilities of LLMs.
Mixture of Efficient Diffusion Experts Through Automatic Interval and Sub-Network Selection
Finally, with a selected configuration, we fine-tune our pruned experts to obtain our mixture of efficient experts.
Personalized Federated Continual Learning via Multi-granularity Prompt
In addition, we design a selective prompt fusion mechanism for aggregating knowledge of global prompts distilled from different clients.
PDSS: A Privacy-Preserving Framework for Step-by-Step Distillation of Large Language Models
In the context of real-world applications, leveraging large language models (LLMs) for domain-specific tasks often faces two major challenges: domain-specific knowledge privacy and constrained resources.
FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models
However, a significant gap remains in the simultaneous mutual enhancement of both the server's LLM and clients' SLMs.
FedAdOb: Privacy-Preserving Federated Deep Learning with Adaptive Obfuscation
Federated learning (FL) has emerged as a collaborative approach that allows multiple clients to jointly learn a machine learning model without sharing their private data.
No Free Lunch Theorem for Privacy-Preserving LLM Inference
Therefore, it is essential to evaluate the balance between the risk of privacy leakage and loss of utility when conducting effective protection mechanisms.
Attention-Driven Training-Free Efficiency Enhancement of Diffusion Models
Specifically, for single-denoising-step pruning, we develop a novel ranking algorithm, Generalized Weighted Page Rank (G-WPR), to identify redundant tokens, and a similarity-based recovery method to restore tokens for the convolution operation.
FedProK: Trustworthy Federated Class-Incremental Learning via Prototypical Feature Knowledge Transfer
Federated Class-Incremental Learning (FCIL) focuses on continually transferring the previous knowledge to learn new classes in dynamic Federated Learning (FL).
FedEval-LLM: Federated Evaluation of Large Language Models on Downstream Tasks with Collective Wisdom
To address these issues, we propose a Federated Evaluation framework of Large Language Models, named FedEval-LLM, that provides reliable performance measurements of LLMs on downstream tasks without the reliance on labeled test sets and external tools, thus ensuring strong privacy-preserving capability.
Hyperparameter Optimization for SecureBoost via Constrained Multi-Objective Federated Learning
This vulnerability may lead the current heuristic hyperparameter configuration of SecureBoost to a suboptimal trade-off between utility, privacy, and efficiency, which are pivotal elements toward a trustworthy federated learning system.
UMAIR-FPS: User-aware Multi-modal Animation Illustration Recommendation Fusion with Painting Style
In the feature extract phase, for image features, we are the first to combine image painting style features with semantic features to construct a dual-output image encoder for enhancing representation.
SNED: Superposition Network Architecture Search for Efficient Video Diffusion Model
Our method employs a supernet training paradigm that targets various model cost and resolution options using a weight-sharing method.
A Theoretical Analysis of Efficiency Constrained Utility-Privacy Bi-Objective Optimization in Federated Learning
Concerns about utility, privacy, and training efficiency in FL have garnered significant research attention.
Quantitative perfusion maps using a novelty spatiotemporal convolutional neural network
The results indicate that the network can accurately estimate perfusion parameters, including cerebral blood volume (CBV), cerebral blood flow (CBF), and time to maximum of the residual function (Tmax).
Grounding Foundation Models through Federated Transfer Learning: A General Framework
Motivated by the strong growth in FTL-FM research and the potential impact of FTL-FM on industrial applications, we propose an FTL-FM framework that formulates problems of grounding FMs in the federated learning setting, construct a detailed taxonomy based on the FTL-FM framework to categorize state-of-the-art FTL-FM works, and comprehensively overview FTL-FM works based on the proposed taxonomy.
FATE-LLM: A Industrial Grade Federated Learning Framework for Large Language Models
FATE-LLM (1) facilitates federated learning for large language models (coined FedLLM); (2) promotes efficient training of FedLLM using parameter-efficient fine-tuning methods; (3) protects the intellectual property of LLMs; (4) preserves data privacy during training and inference through privacy-preserving mechanisms.
Privacy in Large Language Models: Attacks, Defenses and Future Directions
The advancement of large language models (LLMs) has significantly enhanced the ability to effectively tackle various downstream NLP tasks and unify these tasks into generative pipelines.
SecureBoost Hyperparameter Tuning via Multi-Objective Federated Learning
To fill this gap, we propose a Constrained Multi-Objective SecureBoost (CMOSB) algorithm to find Pareto optimal solutions that each solution is a set of hyperparameters achieving optimal tradeoff between utility loss, training cost, and privacy leakage.
A Meta-learning Framework for Tuning Parameters of Protection Mechanisms in Trustworthy Federated Learning
Motivated by this requirement, we propose a framework that (1) formulates TFL as a problem of finding a protection mechanism to optimize the tradeoff between privacy leakage, utility loss, and efficiency reduction and (2) formally defines bounded measurements of the three factors.
Optimizing Privacy, Utility and Efficiency in Constrained Multi-Objective Federated Learning
Different from existing CMOFL works focusing on utility, efficiency, fairness, and robustness, we consider optimizing privacy leakage along with utility loss and training cost, the three primary objectives of a TFL system.
FedPass: Privacy-Preserving Vertical Federated Deep Learning with Adaptive Obfuscation
Vertical federated learning (VFL) allows an active party with labeled feature to leverage auxiliary features from the passive parties to improve model performance.
Vertical Federated Learning: Concepts, Advances and Challenges
Motivated by the rapid growth in VFL research and real-world applications, we provide a comprehensive review of the concept and algorithms of VFL, as well as current advances and challenges in various aspects, including effectiveness, efficiency, and privacy.
A Framework for Evaluating Privacy-Utility Trade-off in Vertical Federated Learning
We then use this framework as a guide to comprehensively evaluate a broad range of protection mechanisms against most of the state-of-the-art privacy attacks for three widely deployed VFL algorithms.
Trading Off Privacy, Utility and Efficiency in Federated Learning
In addition, it is a mandate for a federated learning system to achieve high \textit{efficiency} in order to enable large-scale model training and deployment.
FuncFooler: A Practical Black-box Attack Against Learning-based Binary Code Similarity Detection Methods
The binary code similarity detection (BCSD) method measures the similarity of two binary executable codes.
A Hybrid Self-Supervised Learning Framework for Vertical Federated Learning
In this work, we propose a Federated Hybrid Self-Supervised Learning framework, named FedHSSL, that utilizes cross-party views (i. e., dispersed features) of samples aligned among parties and local views (i. e., augmentation) of unaligned samples within each party to improve the representation learning capability of the VFL joint model.
Batch Label Inference and Replacement Attacks in Black-Boxed Vertical Federated Learning
An immediate defense strategy is to protect sample-level messages communicated with Homomorphic Encryption (HE), and in this way only the batch-averaged local gradients are exposed to each party (termed black-boxed VFL).
Privacy-preserving Federated Adversarial Domain Adaption over Feature Groups for Interpretability
We present a novel privacy-preserving federated adversarial domain adaptation approach ($\textbf{PrADA}$) to address an under-studied but practical cross-silo federated domain adaptation problem, in which the party of the target domain is insufficient in both samples and features.
FedCG: Leverage Conditional GAN for Protecting Privacy and Maintaining Competitive Performance in Federated Learning
Federated learning (FL) aims to protect data privacy by enabling clients to build machine learning models collaboratively without sharing their private data.
SecureBoost+: Large Scale and High-Performance Vertical Federated Gradient Boosting Decision Tree
Gradient boosting decision tree (GBDT) is an ensemble machine learning algorithm, which is widely used in industry, due to its good performance and easy interpretation.
Federated Deep Learning with Bayesian Privacy
To address the aforementioned perplexity, we propose a novel Bayesian Privacy (BP) framework which enables Bayesian restoration attacks to be formulated as the probability of reconstructing private data from observed public information.
FedCVT: Semi-supervised Vertical Federated Learning with Cross-view Training
In this article, we propose Federated Cross-view Training (FedCVT), a semi-supervised learning approach that improves the performance of the VFL model with limited aligned samples.
FedML: A Research Library and Benchmark for Federated Machine Learning
Federated learning (FL) is a rapidly growing research field in machine learning.
A Communication Efficient Collaborative Learning Framework for Distributed Features
We introduce a collaborative learning framework allowing multiple parties having different sets of attributes about the same user to jointly build models without exposing their raw data or model parameters.
Secure and Efficient Federated Transfer Learning
Federated Transfer Learning (FTL) was introduced in [1] to improve statistical models under a data federation that allow knowledge to be shared without compromising user privacy, and enable complementary knowledge to be transferred in the network.
Cryptography and Security
Secure Federated Transfer Learning
A secure transfer cross validation approach is also proposed to guard the FTL performance under the federation.
Picasso, Matisse, or a Fake? Automated Analysis of Drawings at the Stroke Level for Attribution and Authentication
We also propose and compare different classification methods at the drawing level.
