Search Results for author: Han Yu

Found 106 papers, 27 papers with code

A Survey on Artificial Intelligence and Data Mining for MOOCs

no code implementations26 Jan 2016 Simon Fauvel, Han Yu

In this survey paper, we first review the state-of-the-art artificial intelligence and data mining research applied to MOOCs, emphasising the use of AI and DM tools and techniques to improve student engagement, learning outcomes, and our understanding of the MOOC ecosystem.

Surveillance Video Parsing with Single Frame Supervision

no code implementations CVPR 2017 Si Liu, Changhu Wang, Ruihe Qian, Han Yu, Renda Bao

In this paper, we develop a Single frame Video Parsing (SVP) method which requires only one labeled frame per video in training stage.

Optical Flow Estimation

Cross-position Activity Recognition with Stratified Transfer Learning

no code implementations26 Jun 2018 Yiqiang Chen, Jindong Wang, Meiyu Huang, Han Yu

STL consists of two components: Stratified Domain Selection (STL-SDS) can select the most similar source domain to the target domain; Stratified Activity Transfer (STL-SAT) is able to perform accurate knowledge transfer.

Human Activity Recognition Position +1

Autoencoder Based Sample Selection for Self-Taught Learning

no code implementations5 Aug 2018 Siwei Feng, Han Yu, Marco F. Duarte

In this paper, we propose a metric for the relevance between a source sample and the target samples.

Transfer Learning

Building Ethics into Artificial Intelligence

no code implementations7 Dec 2018 Han Yu, Zhiqi Shen, Chunyan Miao, Cyril Leung, Victor R. Lesser, Qiang Yang

As artificial intelligence (AI) systems become increasingly ubiquitous, the topic of AI governance for ethical decision-making by AI has captured public imagination.

Decision Making Ethics

Ethically Aligned Opportunistic Scheduling for Productive Laziness

no code implementations2 Jan 2019 Han Yu, Chunyan Miao, Yongqing Zheng, Lizhen Cui, Simon Fauvel, Cyril Leung

In order to enable workforce management systems to follow the IEEE Ethically Aligned Design guidelines to prioritize worker wellbeing, we propose a distributed Computational Productive Laziness (CPL) approach in this paper.

Management Scheduling

Easy Transfer Learning By Exploiting Intra-domain Structures

1 code implementation2 Apr 2019 Jindong Wang, Yiqiang Chen, Han Yu, Meiyu Huang, Qiang Yang

In this paper, we propose a practically Easy Transfer Learning (EasyTL) approach which requires no model selection and hyperparameter tuning, while achieving competitive performance.

Computational Efficiency Domain Adaptation +2

Incentive Design for Efficient Federated Learning in Mobile Networks: A Contract Theory Approach

no code implementations16 May 2019 Jiawen Kang, Zehui Xiong, Dusit Niyato, Han Yu, Ying-Chang Liang, Dong In Kim

To strengthen data privacy and security, federated learning as an emerging machine learning technique is proposed to enable large-scale nodes, e. g., mobile devices, to distributedly train and globally share models without revealing their local data.

Federated Learning

Towards Fair and Privacy-Preserving Federated Deep Models

1 code implementation4 Jun 2019 Lingjuan Lyu, Jiangshan Yu, Karthik Nandakumar, Yitong Li, Xingjun Ma, Jiong Jin, Han Yu, Kee Siong Ng

This problem can be addressed by either a centralized framework that deploys a central server to train a global model on the joint data from all parties, or a distributed framework that leverages a parameter server to aggregate local model updates.

Benchmarking Fairness +3

Privacy-preserving Crowd-guided AI Decision-making in Ethical Dilemmas

no code implementations4 Jun 2019 Teng Wang, Jun Zhao, Han Yu, Jinyan Liu, Xinyu Yang, Xuebin Ren, Shuyu Shi

To investigate such ethical dilemmas, recent studies have adopted preference aggregation, in which each voter expresses her/his preferences over decisions for the possible ethical dilemma scenarios, and a centralized system aggregates these preferences to obtain the winning decision.

Autonomous Vehicles Decision Making +1

Transfer Learning with Dynamic Distribution Adaptation

1 code implementation17 Sep 2019 Jindong Wang, Yiqiang Chen, Wenjie Feng, Han Yu, Meiyu Huang, Qiang Yang

Since the source and the target domains are usually from different distributions, existing methods mainly focus on adapting the cross-domain marginal or conditional distributions.

Domain Adaptation Image Classification +2

Reviewing and Improving the Gaussian Mechanism for Differential Privacy

no code implementations27 Nov 2019 Jun Zhao, Teng Wang, Tao Bai, Kwok-Yan Lam, Zhiying Xu, Shuyu Shi, Xuebin Ren, Xinyu Yang, Yang Liu, Han Yu

Although both classical Gaussian mechanisms [1, 2] assume $0 < \epsilon \leq 1$, our review finds that many studies in the literature have used the classical Gaussian mechanisms under values of $\epsilon$ and $\delta$ where the added noise amounts of [1, 2] do not achieve $(\epsilon,\delta)$-DP.

FOCUS: Dealing with Label Quality Disparity in Federated Learning

1 code implementation29 Jan 2020 Yiqiang Chen, Xiaodong Yang, Xin Qin, Han Yu, Biao Chen, Zhiqi Shen

It maintains a small set of benchmark samples on the FL server and quantifies the credibility of the client local data without directly observing them by computing the mutual cross-entropy between performance of the FL model on the local datasets and that of the client local FL model on the benchmark dataset.

Federated Learning Privacy Preserving

Multi-Participant Multi-Class Vertical Federated Learning

no code implementations30 Jan 2020 Siwei Feng, Han Yu

Federated learning (FL) is a privacy-preserving paradigm for training collective machine learning models with locally stored data from multiple participants.

feature selection Multi-class Classification +3

Byzantine-resilient Decentralized Stochastic Gradient Descent

no code implementations20 Feb 2020 Shangwei Guo, Tianwei Zhang, Han Yu, Xiaofei Xie, Lei Ma, Tao Xiang, Yang Liu

It guarantees that each benign node in a decentralized system can train a correct model under very strong Byzantine attacks with an arbitrary number of faulty nodes.

Edge-computing Image Classification

FedCoin: A Peer-to-Peer Payment System for Federated Learning

1 code implementation26 Feb 2020 Yuan Liu, Shuai Sun, Zhengpeng Ai, Shuangfeng Zhang, Zelei Liu, Han Yu

In FedCoin, blockchain consensus entities calculate SVs and a new block is created based on the proof of Shapley (PoSap) protocol.

Federated Learning

Threats to Federated Learning: A Survey

no code implementations4 Mar 2020 Lingjuan Lyu, Han Yu, Qiang Yang

It is thus of paramount importance to make FL system designers to be aware of the implications of future FL algorithm design on privacy-preservation.

Federated Learning

AliExpress Learning-To-Rank: Maximizing Online Model Performance without Going Online

no code implementations25 Mar 2020 Guangda Huzhang, Zhen-Jia Pang, Yongqing Gao, Yawen Liu, Weijie Shen, Wen-Ji Zhou, Qing Da, An-Xiang Zeng, Han Yu, Yang Yu, Zhi-Hua Zhou

The framework consists of an evaluator that generalizes to evaluate recommendations involving the context, and a generator that maximizes the evaluator score by reinforcement learning, and a discriminator that ensures the generalization of the evaluator.

Learning-To-Rank

Topology-aware Differential Privacy for Decentralized Image Classification

no code implementations14 Jun 2020 Shangwei Guo, Tianwei Zhang, Guowen Xu, Han Yu, Tao Xiang, Yang Liu

In this paper, we design Top-DP, a novel solution to optimize the differential privacy protection of decentralized image classification systems.

Classification Image Classification

Privacy-Preserving Technology to Help Millions of People: Federated Prediction Model for Stroke Prevention

no code implementations15 Jun 2020 Ce Ju, Ruihui Zhao, Jichao Sun, Xiguang Wei, Bo Zhao, Yang Liu, Hongshan Li, Tianjian Chen, Xinwei Zhang, Dashan Gao, Ben Tan, Han Yu, Chuning He, Yuan Jin

It adopts federated averaging during the model training process, without patient data being taken out of the hospitals during the whole process of model training and forecasting.

Privacy Preserving

SCNet: A Neural Network for Automated Side-Channel Attack

1 code implementation2 Aug 2020 Guanlin Li, Chang Liu, Han Yu, Yanhong Fan, Libang Zhang, Zongyue Wang, Meiqin Wang

Information about system characteristics such as power consumption, electromagnetic leaks and sound can be exploited by the side-channel attack to compromise the system.

A Robust Spearman Correlation Coefficient Permutation Test

1 code implementation3 Aug 2020 Han Yu, Alan D. Hutson

In general, there is common misconception that the tests about $\rho_s=0$ are robust to deviations from bivariate normality.

Methodology Applications

A VCG-based Fair Incentive Mechanism for Federated Learning

no code implementations15 Aug 2020 Mingshu Cong, Han Yu, Xi Weng, Jiabao Qu, Yang Liu, Siu Ming Yiu

In order to build an ecosystem for FL to operate in a sustainable manner, it has to be economically attractive to data owners.

Computer Science and Game Theory

Federated Crowdsensing: Framework and Challenges

no code implementations6 Nov 2020 Leye Wang, Han Yu, Xiao Han

In particular, we first propose a federated crowdsensing framework, which analyzes the privacy concerns of each crowdsensing stage (i. e., task creation, task assignment, task execution, and data aggregation) and discuss how federated learning techniques may take effect.

Federated Learning

Federated Learning for Personalized Humor Recognition

no code implementations3 Dec 2020 Xu Guo, Han Yu, Boyang Li, Hao Wang, Pengwei Xing, Siwei Feng, Zaiqing Nie, Chunyan Miao

In this paper, we propose the FedHumor approach for the recognition of humorous content in a personalized manner through Federated Learning (FL).

Federated Learning Language Modelling

Privacy and Robustness in Federated Learning: Attacks and Defenses

no code implementations7 Dec 2020 Lingjuan Lyu, Han Yu, Xingjun Ma, Chen Chen, Lichao Sun, Jun Zhao, Qiang Yang, Philip S. Yu

Besides training powerful global models, it is of paramount importance to design FL systems that have privacy guarantees and are resistant to different types of adversaries.

Federated Learning Privacy Preserving

HYDRA: Hypergradient Data Relevance Analysis for Interpreting Deep Neural Networks

1 code implementation4 Feb 2021 YuanYuan Chen, Boyang Li, Han Yu, Pengcheng Wu, Chunyan Miao

the weights of training data, HYDRA assesses the contribution of training data toward test data points throughout the training trajectory.

Rolling Shutter Correction

Towards Personalized Federated Learning

no code implementations1 Mar 2021 Alysa Ziying Tan, Han Yu, Lizhen Cui, Qiang Yang

In parallel with the rapid adoption of Artificial Intelligence (AI) empowered by advances in AI research, there have been growing awareness and concerns of data privacy.

Benchmarking Personalized Federated Learning +1

Latent-Optimized Adversarial Neural Transfer for Sarcasm Detection

1 code implementation NAACL 2021 Xu Guo, Boyang Li, Han Yu, Chunyan Miao

The existence of multiple datasets for sarcasm detection prompts us to apply transfer learning to exploit their commonality.

Meta-Learning Sarcasm Detection +1

Forecasting Health and Wellbeing for Shift Workers Using Job-role Based Deep Neural Network

1 code implementation22 Jun 2021 Han Yu, Asami Itoh, Ryota Sakamoto, Motomu Shimaoka, Akane Sano

According to the differences in self-reported health and wellbeing labels between nurses and doctors, and the correlations among their labels, we proposed a job-role based multitask and multilabel deep learning model, where we modeled physiological and behavioral data for nurses and doctors simultaneously to predict participants' next day's multidimensional self-reported health and wellbeing status.

Modality Fusion Network and Personalized Attention in Momentary Stress Detection in the Wild

1 code implementation19 Jul 2021 Han Yu, Thomas Vaessen, Inez Myin-Germeys, Akane Sano

Compared to the baseline method using the samples with complete modalities, the performance of the MFN improved by 1. 6% in f1-scores.

Transfer Learning

Noise-Resistant Deep Metric Learning with Probabilistic Instance Filtering

no code implementations3 Aug 2021 Chang Liu, Han Yu, Boyang Li, Zhiqi Shen, Zhanning Gao, Peiran Ren, Xuansong Xie, Lizhen Cui, Chunyan Miao

Noisy labels are commonly found in real-world data, which cause performance degradation of deep neural networks.

Metric Learning

Towards Out-Of-Distribution Generalization: A Survey

no code implementations31 Aug 2021 Jiashuo Liu, Zheyan Shen, Yue He, Xingxuan Zhang, Renzhe Xu, Han Yu, Peng Cui

This paper represents the first comprehensive, systematic review of OOD generalization, encompassing a spectrum of aspects from problem definition, methodological development, and evaluation procedures, to the implications and future directions of the field.

Out-of-Distribution Generalization Representation Learning

GTG-Shapley: Efficient and Accurate Participant Contribution Evaluation in Federated Learning

1 code implementation5 Sep 2021 Zelei Liu, YuanYuan Chen, Han Yu, Yang Liu, Lizhen Cui

In addition, we design a guided Monte Carlo sampling approach combined with within-round and between-round truncation to further reduce the number of model reconstructions and evaluations required, through extensive experiments under diverse realistic data distribution settings.

Computational Efficiency Federated Learning

MarS-FL: Enabling Competitors to Collaborate in Federated Learning

no code implementations26 Oct 2021 Xiaohu Wu, Han Yu

A key unaddressed scenario is that these FL participants are in a competitive market, where market shares represent their competitiveness.

Decision Making Federated Learning +1

Towards Fairness-Aware Federated Learning

no code implementations2 Nov 2021 Yuxin Shi, Han Yu, Cyril Leung

However, most current works focus on the interest of the central controller in FL, and overlook the interests of the FL clients.

Fairness Federated Learning

Automatic Product Copywriting for E-Commerce

no code implementations15 Dec 2021 Xueying Zhang, Yanyan Zou, Hainan Zhang, Jing Zhou, Shiliang Diao, Jiajia Chen, Zhuoye Ding, Zhen He, Xueqi He, Yun Xiao, Bo Long, Han Yu, Lingfei Wu

It consists of two main components: 1) natural language generation, which is built from a transformer-pointer network and a pre-trained sequence-to-sequence model based on millions of training data from our in-house platform; and 2) copywriting quality control, which is based on both automatic evaluation and human screening.

Product Recommendation Text Generation

Adaptive Memory Networks with Self-supervised Learning for Unsupervised Anomaly Detection

no code implementations3 Jan 2022 Yuxin Zhang, Jindong Wang, Yiqiang Chen, Han Yu, Tao Qin

In this paper, we propose a novel approach called Adaptive Memory Network with Self-supervised Learning (AMSL) to address these challenges and enhance the generalization ability in unsupervised anomaly detection.

Self-Supervised Learning Sleep Stage Detection +3

Heterogeneous Federated Learning via Grouped Sequential-to-Parallel Training

no code implementations31 Jan 2022 Shenglai Zeng, Zonghang Li, Hongfang Yu, Yihong He, Zenglin Xu, Dusit Niyato, Han Yu

In this paper, we propose a data heterogeneity-robust FL approach, FedGSP, to address this challenge by leveraging on a novel concept of dynamic Sequential-to-Parallel (STP) collaborative training.

Federated Learning Privacy Preserving

Towards Verifiable Federated Learning

no code implementations15 Feb 2022 Yanci Zhang, Han Yu

Federated learning (FL) is an emerging paradigm of collaborative machine learning that preserves user privacy while building powerful models.

Federated Learning

Federated Graph Neural Networks: Overview, Techniques and Challenges

no code implementations15 Feb 2022 Rui Liu, Pengwei Xing, Zichao Deng, Anran Li, Cuntai Guan, Han Yu

This has led to the rapid development of the emerging research field of federated graph neural networks (FedGNNs).

Federated Learning

More to Less (M2L): Enhanced Health Recognition in the Wild with Reduced Modality of Wearable Sensors

1 code implementation16 Feb 2022 Huiyuan Yang, Han Yu, Kusha Sridhar, Thomas Vaessen, Inez Myin-Germeys, Akane Sano

For example, although combining bio-signals from multiple sensors (i. e., a chest pad sensor and a wrist wearable sensor) has been proved effective for improved performance, wearing multiple devices might be impractical in the free-living context.

Transfer Learning

Semi-Supervised Learning and Data Augmentation in Wearable-based Momentary Stress Detection in the Wild

no code implementations22 Feb 2022 Han Yu, Akane Sano

We first applied data augmentation techniques on the physiological and behavioral data to improve the robustness of supervised stress detection models.

Data Augmentation

NICO++: Towards Better Benchmarking for Domain Generalization

2 code implementations CVPR 2023 Xingxuan Zhang, Yue He, Renzhe Xu, Han Yu, Zheyan Shen, Peng Cui

Most current evaluation methods for domain generalization (DG) adopt the leave-one-out strategy as a compromise on the limited number of domains.

Benchmarking Domain Generalization +2

Bias Reducing Multitask Learning on Mental Health Prediction

no code implementations7 Aug 2022 Khadija Zanna, Kusha Sridhar, Han Yu, Akane Sano

However, there is still a lack of standard in evaluating bias in such machine learning models in the field, which leads to challenges in providing reliable predictions and in addressing disparities.

Fairness Feature Importance +2

FedOBD: Opportunistic Block Dropout for Efficiently Training Large-scale Neural Networks through Federated Learning

1 code implementation10 Aug 2022 YuanYuan Chen, Zichen Chen, Pengcheng Wu, Han Yu

To the best of our knowledge, FedOBD is the first approach to perform dropout on FL models at the block level rather than at the individual parameter level.

Federated Learning

Towards Trustworthy AI-Empowered Real-Time Bidding for Online Advertisement Auctioning

no code implementations21 Sep 2022 Xiaoli Tang, Han Yu

As such, building trustworthy AIRTB auctioning systems has emerged as an important direction of research in this field in recent years.

Fairness

Improving the Sample Efficiency of Prompt Tuning with Domain Adaptation

1 code implementation6 Oct 2022 Xu Guo, Boyang Li, Han Yu

Prompt tuning, or the conditioning of a frozen pretrained language model (PLM) with soft prompts learned from data, has demonstrated impressive performance on a wide range of NLP tasks.

Domain Adaptation Language Modelling

Empirical Evaluation of Data Augmentations for Biobehavioral Time Series Data with Deep Learning

1 code implementation13 Oct 2022 Huiyuan Yang, Han Yu, Akane Sano

As an effective technique to increase the data variability and thus train deep models with better generalization, data augmentation (DA) is a critical step for the success of deep learning models on biobehavioral time series data.

Data Augmentation Time Series +1

Measure-Theoretic Probability of Complex Co-occurrence and E-Integral

no code implementations18 Oct 2022 Jian-Yong Wang, Han Yu

Probability and conditional probability of co-occurrence are introduced by being defined in a general setting with set functions to develop a rigorous measure-theoretic foundation for the inherent challenge of data sparseness.

Multi-Resource Allocation for On-Device Distributed Federated Learning Systems

no code implementations1 Nov 2022 Yulan Gao, Ziqiang Ye, Han Yu, Zehui Xiong, Yue Xiao, Dusit Niyato

This work poses a distributed multi-resource allocation scheme for minimizing the weighted sum of latency and energy consumption in the on-device distributed federated learning (FL) system.

Federated Learning

On the Domain Adaptation and Generalization of Pretrained Language Models: A Survey

no code implementations6 Nov 2022 Xu Guo, Han Yu

Recent advances in NLP are brought by a range of large-scale pretrained language models (PLMs).

Domain Adaptation Model Optimization

FIXED: Frustratingly Easy Domain Generalization with Mixup

1 code implementation7 Nov 2022 Wang Lu, Jindong Wang, Han Yu, Lei Huang, Xiang Zhang, Yiqiang Chen, Xing Xie

Firstly, Mixup cannot effectively identify the domain and class information that can be used for learning invariant representations.

Domain Generalization Image Classification +2

PiRL: Participant-Invariant Representation Learning for Healthcare

no code implementations21 Nov 2022 Zhaoyang Cao, Han Yu, Huiyuan Yang, Akane Sano

Due to individual heterogeneity, performance gaps are observed between generic (one-size-fits-all) models and person-specific models in data-driven health applications.

Representation Learning

Stable Learning via Sparse Variable Independence

no code implementations2 Dec 2022 Han Yu, Peng Cui, Yue He, Zheyan Shen, Yong Lin, Renzhe Xu, Xingxuan Zhang

The problem of covariate-shift generalization has attracted intensive research attention.

Variable Selection

Towards AI-Empowered Crowdsourcing

no code implementations28 Dec 2022 Shipeng Wang, Qingzhong Li, Lizhen Cui, Zhongmin Yan, Yonghui Xu, Zhuan Shi, Xinping Min, Zhiqi Shen, Han Yu

Crowdsourcing, in which human intelligence and productivity is dynamically mobilized to tackle tasks too complex for automation alone to handle, has grown to be an important research topic and inspired new businesses (e. g., Uber, Airbnb).

Management

Optimising Event-Driven Spiking Neural Network with Regularisation and Cutoff

1 code implementation23 Jan 2023 Dengyu Wu, Gaojie Jin, Han Yu, Xinping Yi, Xiaowei Huang

The Top-K cutoff technique optimises the inference of SNN, and the regularisation are proposed to affect the training and construct SNN with optimised performance for cutoff.

Computational Efficiency

Clustered Embedding Learning for Recommender Systems

no code implementations3 Feb 2023 Yizhou Chen, Guangda Huzhang, AnXiang Zeng, Qingtao Yu, Hui Sun, Heng-yi Li, Jingyi Li, Yabo Ni, Han Yu, Zhiming Zhou

However, such a method has two important limitations in real-world applications: 1) it is hard to learn embeddings that generalize well for users and items with rare interactions on their own; and 2) it may incur unbearably high memory costs when the number of users and items scales up.

Recommendation Systems

PiRL: Participant-Invariant Representation Learning for Healthcare Using Maximum Mean Discrepancy and Triplet Loss

no code implementations17 Feb 2023 Zhaoyang Cao, Han Yu, Huiyuan Yang, Akane Sano

Due to individual heterogeneity, person-specific models are usually achieving better performance than generic (one-size-fits-all) models in data-driven health applications.

Representation Learning

FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learning

no code implementations21 Feb 2023 Anran Li, Hongyi Peng, Lan Zhang, Jiahui Huang, Qing Guo, Han Yu, Yang Liu

Vertical Federated Learning (VFL) enables multiple data owners, each holding a different subset of features about largely overlapping sets of data sample(s), to jointly train a useful global model.

Feature Importance feature selection +1

Towards Interpretable Federated Learning

no code implementations27 Feb 2023 Anran Li, Rui Liu, Ming Hu, Luu Anh Tuan, Han Yu

Federated learning (FL) enables multiple data owners to build machine learning models collaboratively without exposing their private local data.

Federated Learning

Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization

1 code implementation CVPR 2023 Xingxuan Zhang, Renzhe Xu, Han Yu, Hao Zou, Peng Cui

Yet the current definition of flatness discussed in SAM and its follow-ups are limited to the zeroth-order flatness (i. e., the worst-case loss within a perturbation radius).

FedGH: Heterogeneous Federated Learning with Generalized Global Header

3 code implementations23 Mar 2023 Liping Yi, Gang Wang, Xiaoguang Liu, Zhuan Shi, Han Yu

It is a communication and computation-efficient model-heterogeneous FL framework which trains a shared generalized global prediction header with representations extracted by heterogeneous extractors for clients' models at the FL server.

Federated Learning Privacy Preserving

DADFNet: Dual Attention and Dual Frequency-Guided Dehazing Network for Video-Empowered Intelligent Transportation

no code implementations19 Apr 2023 Yu Guo, Ryan Wen Liu, Jiangtian Nie, Lingjuan Lyu, Zehui Xiong, Jiawen Kang, Han Yu, Dusit Niyato

To eliminate the influences of adverse weather conditions, we propose a dual attention and dual frequency-guided dehazing network (termed DADFNet) for real-time visibility enhancement.

Management object-detection +1

Utility-Maximizing Bidding Strategy for Data Consumers in Auction-based Federated Learning

no code implementations11 May 2023 Xiaoli Tang, Han Yu

However, this assumption is not realistic in practical AFL marketplaces in which multiple data consumers can compete to attract data owners to join their respective FL tasks.

Federated Learning

Multi-Tier Client Selection for Mobile Federated Learning Networks

no code implementations11 May 2023 Yulan Gao, Yansong Zhao, Han Yu

However, the problem of optimizing FL client selection in mobile federated learning networks (MFLNs), where devices move in and out of each others' coverage and no FL server knows all the data owners, remains open.

Federated Learning

Rethinking the Evaluation Protocol of Domain Generalization

no code implementations24 May 2023 Han Yu, Xingxuan Zhang, Renzhe Xu, Jiashuo Liu, Yue He, Peng Cui

This paper examines the risks of test data information leakage from two aspects of the current evaluation protocol: supervised pretraining on ImageNet and oracle model selection.

Domain Generalization Model Selection

Meta Adaptive Task Sampling for Few-Domain Generalization

no code implementations25 May 2023 Zheyan Shen, Han Yu, Peng Cui, Jiashuo Liu, Xingxuan Zhang, Linjun Zhou, Furui Liu

Moreover, we propose a Meta Adaptive Task Sampling (MATS) procedure to differentiate base tasks according to their semantic and domain-shift similarity to the novel task.

Domain Generalization

Towards Quantum Federated Learning

no code implementations16 Jun 2023 Chao Ren, Han Yu, Rudai Yan, Minrui Xu, Yuan Shen, Huihui Zhu, Dusit Niyato, Zhao Yang Dong, Leong Chuan Kwek

This review serves as a first-of-its-kind comprehensive guide for researchers and practitioners interested in understanding and advancing the field of QFL.

Federated Learning

Cost-Effective Task Offloading Scheduling for Hybrid Mobile Edge-Quantum Computing

no code implementations26 Jun 2023 Ziqiang Ye, Yulan Gao, Yue Xiao, Minrui Xu, Han Yu, Dusit Niyato

We develop cost-effective designs for both task offloading mode selection and resource allocation, subject to the individual link latency constraint guarantees for mobile devices, while satisfying the required success ratio for their computation tasks.

Decision Making Scheduling

Hierarchical Federated Learning Incentivization for Gas Usage Estimation

no code implementations1 Jul 2023 Has Sun, Xiaoli Tang, Chengyi Yang, Zhenpeng Yu, Xiuli Wang, Qijie Ding, Zengxiang Li, Han Yu

Federated learning (FL) offers a solution to this problem by enabling local data processing on each participant, such as gas companies and heating stations.

Fairness Federated Learning

Flatness-Aware Minimization for Domain Generalization

no code implementations ICCV 2023 Xingxuan Zhang, Renzhe Xu, Han Yu, Yancheng Dong, Pengfei Tian, Peng Cu

However, we reveal that Adam is not necessarily the optimal choice for the majority of current DG methods and datasets.

Domain Generalization FAD

Fairness-Aware Client Selection for Federated Learning

no code implementations20 Jul 2023 Yuxin Shi, Zelei Liu, Zhuan Shi, Han Yu

By not using threshold-based reputation filtering, it provides FL clients with opportunities to redeem their reputations after a perceived poor performance, thereby further enhancing fair client treatment.

Fairness Federated Learning

The Prospect of Enhancing Large-Scale Heterogeneous Federated Learning with Transformers

no code implementations7 Aug 2023 Yulan Gao, Zhaoxiang Hou, Chengyi Yang, Zengxiang Li, Han Yu

Federated learning (FL) addresses data privacy concerns by enabling collaborative training of AI models across distributed data owners.

Federated Learning

Aggregating Intrinsic Information to Enhance BCI Performance through Federated Learning

no code implementations14 Aug 2023 Rui Liu, YuanYuan Chen, Anran Li, Yi Ding, Han Yu, Cuntai Guan

Though numerous research groups and institutes collect a multitude of EEG datasets for the same BCI task, sharing EEG data from multiple sites is still challenging due to the heterogeneity of devices.

EEG Eeg Decoding +2

LR-XFL: Logical Reasoning-based Explainable Federated Learning

1 code implementation24 Aug 2023 Yanci Zhang, Han Yu

Under LR-XFL, FL clients create local logic rules based on their local data and send them, along with model updates, to the FL server.

Federated Learning Logical Reasoning

FedLogic: Interpretable Federated Multi-Domain Chain-of-Thought Prompt Selection for Large Language Models

no code implementations29 Aug 2023 Pengwei Xing, Songtao Lu, Han Yu

To improve interpretability and explore the balance principle between generality and personalization under a multi-domain CoT prompt selection scenario, we propose the Federated Logic rule learning approach (FedLogic).

Efficient RLHF: Reducing the Memory Usage of PPO

no code implementations1 Sep 2023 Michael Santacroce, Yadong Lu, Han Yu, Yuanzhi Li, Yelong Shen

To address this issue, we present a comprehensive analysis the memory usage, performance, and training time of memory-savings techniques for PPO.

Language Modelling

Image Aesthetics Assessment via Learnable Queries

no code implementations6 Sep 2023 Zhiwei Xiong, Yunfan Zhang, Zhiqi Shen, Peiran Ren, Han Yu

Image aesthetics assessment (IAA) aims to estimate the aesthetics of images.

ECG-SL: Electrocardiogram(ECG) Segment Learning, a deep learning method for ECG signal

no code implementations1 Oct 2023 Han Yu, Huiyuan Yang, Akane Sano

In this work, we propose a novel ECG-Segment based Learning (ECG-SL) framework to explicitly model the periodic nature of ECG signals.

Attribute Self-Supervised Learning +1

Hire When You Need to: Gradual Participant Recruitment for Auction-based Federated Learning

no code implementations4 Oct 2023 Xavier Tan, Han Yu

The success of Federated Learning (FL) depends on the quantity and quality of the data owners (DOs) as well as their motivation to join FL model training.

Federated Learning Selection bias

pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning

no code implementations20 Oct 2023 Liping Yi, Han Yu, Gang Wang, Xiaoguang Liu, Xiaoxiao Li

Federated learning (FL) is an emerging machine learning paradigm in which a central server coordinates multiple participants (clients) collaboratively to train on decentralized data.

Personalized Federated Learning

pFedES: Model Heterogeneous Personalized Federated Learning with Feature Extractor Sharing

no code implementations12 Nov 2023 Liping Yi, Han Yu, Gang Wang, Xiaoguang Liu

To allow each data owner (a. k. a., FL clients) to train a heterogeneous and personalized local model based on its local data distribution, system resources and requirements on model structure, the field of model-heterogeneous personalized federated learning (MHPFL) has emerged.

Personalized Federated Learning Privacy Preserving +1

Multi-Session Budget Optimization for Forward Auction-based Federated Learning

no code implementations21 Nov 2023 Xiaoli Tang, Han Yu

Based on hierarchical reinforcement learning, MultiBOS-AFL jointly optimizes inter-session budget pacing and intra-session bidding for AFL MUs, with the objective of maximizing the total utility.

Federated Learning Hierarchical Reinforcement Learning

Transformer-empowered Multi-modal Item Embedding for Enhanced Image Search in E-Commerce

no code implementations29 Nov 2023 Chang Liu, Peng Hou, AnXiang Zeng, Han Yu

Since its deployment in March 2023, it has achieved a remarkable 9. 90% increase in terms of clicks per user and a 4. 23% boost in terms of orders per user for the image search feature on the Shopee e-commerce platform.

Image Retrieval Retrieval

Multi-dimensional Fair Federated Learning

no code implementations9 Dec 2023 Cong Su, Guoxian Yu, Jun Wang, Hui Li, Qingzhong Li, Han Yu

Federated learning (FL) has emerged as a promising collaborative and secure paradigm for training a model from decentralized data without compromising privacy.

Fairness Federated Learning

Machine Learning Assisted Adjustment Boosts Inferential Efficiency of Randomized Controlled Trials

no code implementations5 Mar 2024 Han Yu, Alan D. Hutson

In this work, we proposed a novel inferential procedure assisted by machine learning based adjustment for randomized control trials.

Fairness-Aware Multi-Server Federated Learning Task Delegation over Wireless Networks

no code implementations14 Mar 2024 Yulan Gao, Chao Ren, Han Yu

In the rapidly advancing field of federated learning (FL), ensuring efficient FL task delegation while incentivising FL client participation poses significant challenges, especially in wireless networks where FL participants' coverage is limited.

Fairness Federated Learning

A Note on LoRA

no code implementations7 Apr 2024 Vlad Fomenko, Han Yu, Jongho Lee, Stanley Hsieh, Weizhu Chen

LoRA (Low-Rank Adaptation) has emerged as a preferred method for efficiently adapting Large Language Models (LLMs) with remarkable simplicity and efficacy.

Intelligent Agents for Auction-based Federated Learning: A Survey

no code implementations20 Apr 2024 Xiaoli Tang, Han Yu, Xiaoxiao Li, Sarit Kraus

To enhance the efficiency in AFL decision support for stakeholders (i. e., data consumers, data owners, and the auctioneer), intelligent agent-based techniques have emerged.

Federated Learning

Advances and Open Challenges in Federated Learning with Foundation Models

no code implementations23 Apr 2024 Chao Ren, Han Yu, Hongyi Peng, Xiaoli Tang, Anran Li, Yulan Gao, Alysa Ziying Tan, Bo Zhao, Xiaoxiao Li, Zengxiang Li, Qiang Yang

The integration of Foundation Models (FMs) with Federated Learning (FL) presents a transformative paradigm in Artificial Intelligence (AI), offering enhanced capabilities while addressing concerns of privacy, data decentralization, and computational efficiency.

Federated Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.