Search Results for author: Dezhong Yao

Found 16 papers, 7 papers with code

Securely Fine-tuning Pre-trained Encoders Against Adversarial Examples

1 code implementation16 Mar 2024 Ziqi Zhou, Minghui Li, Wei Liu, Shengshan Hu, Yechao Zhang, Wei Wan, Lulu Xue, Leo Yu Zhang, Dezhong Yao, Hai Jin

In response to these challenges, we propose Genetic Evolution-Nurtured Adversarial Fine-tuning (Gen-AF), a two-stage adversarial fine-tuning approach aimed at enhancing the robustness of downstream models.

Self-Supervised Learning

Revisiting Gradient Pruning: A Dual Realization for Defending against Gradient Attacks

no code implementations30 Jan 2024 Lulu Xue, Shengshan Hu, Ruizhi Zhao, Leo Yu Zhang, Shengqing Hu, Lichao Sun, Dezhong Yao

To mitigate the weaknesses of existing solutions, we propose a novel defense method, Dual Gradient Pruning (DGP), based on gradient pruning, which can improve communication efficiency while preserving the utility and privacy of CL.

FedRKG: A Privacy-preserving Federated Recommendation Framework via Knowledge Graph Enhancement

1 code implementation20 Jan 2024 Dezhong Yao, Tongtong Liu, Qi Cao, Hai Jin

Federated Learning (FL) has emerged as a promising approach for preserving data privacy in recommendation systems by training models locally.

Federated Learning Privacy Preserving +1

Temporal Dynamic Synchronous Functional Brain Network for Schizophrenia Diagnosis and Lateralization Analysis

1 code implementation31 Mar 2023 Cheng Zhu, Ying Tan, Shuqi Yang, Jiaqing Miao, JiaYi Zhu, Huan Huang, Dezhong Yao, Cheng Luo

The available evidence suggests that dynamic functional connectivity (dFC) can capture time-varying abnormalities in brain activity in resting-state cerebral functional magnetic resonance imaging (rs-fMRI) data and has a natural advantage in uncovering mechanisms of abnormal brain activity in schizophrenia(SZ) patients.

Short-length SSVEP data extension by a novel generative adversarial networks based framework

1 code implementation13 Jan 2023 Yudong Pan, Ning li, Yangsong Zhang, Peng Xu, Dezhong Yao

This study substantiates the feasibility of the proposed method to extend the data length for short-time SSVEP signals for developing a high-performance BCI system.

EEG SSVEP

A Spatial-channel-temporal-fused Attention for Spiking Neural Networks

no code implementations22 Sep 2022 Wuque Cai, Hongze Sun, Rui Liu, Yan Cui, Jun Wang, Yang Xia, Dezhong Yao, Daqing Guo

Spiking neural networks (SNNs) mimic brain computational strategies, and exhibit substantial capabilities in spatiotemporal information processing.

A Synapse-Threshold Synergistic Learning Approach for Spiking Neural Networks

1 code implementation10 Jun 2022 Hongze Sun, Wuque Cai, Baoxin Yang, Yan Cui, Yang Xia, Dezhong Yao, Daqing Guo

Most existing methods for training SNNs are based on the concept of synaptic plasticity; however, learning in the realistic brain also utilizes intrinsic non-synaptic mechanisms of neurons.

Event data classification Gesture Recognition +1

Entity Resolution with Hierarchical Graph Attention Networks

1 code implementation SIGMOD/PODS 2022 Dezhong Yao, Yuhong Gu, Gao Cong, Hai Jin, Xinqiao Lv

However, there is often interdependence between different pairs of ER decisions, e. g., the entities from the same data source are usually semantically related to each other.

Attribute Entity Resolution +2

FedHM: Efficient Federated Learning for Heterogeneous Models via Low-rank Factorization

no code implementations29 Nov 2021 Dezhong Yao, Wanning Pan, Michael J O'Neill, Yutong Dai, Yao Wan, Hai Jin, Lichao Sun

To this end, this paper proposes FedHM, a novel heterogeneous federated model compression framework, distributing the heterogeneous low-rank models to clients and then aggregating them into a full-rank model.

Distributed Computing Federated Learning +3

Local-Global Knowledge Distillation in Heterogeneous Federated Learning with Non-IID Data

no code implementations30 Jun 2021 Dezhong Yao, Wanning Pan, Yutong Dai, Yao Wan, Xiaofeng Ding, Hai Jin, Zheng Xu, Lichao Sun

Federated learning enables multiple clients to collaboratively learn a global model by periodically aggregating the clients' models without transferring the local data.

Federated Learning Knowledge Distillation

Sparse online relative similarity learning

no code implementations15 Apr 2021 Dezhong Yao, Peilin Zhao, Chen Yu, Hai Jin, Bin Li

This is clearly inefficient for high dimensional tasks due to its high memory and computational complexity.

Metric Learning

Time irreversibility and amplitude irreversibility measures for nonequilibrium processes

no code implementations19 Aug 2020 Wenpo Yao, Jun Wang, Matjaz Perc, Wenli Yao, Jiafei Dai, Daqing Guo, Dezhong Yao

Time irreversibility should be measured based on the permutations of symmetric vectors rather than symmetric permutations, whereas symmetric permutations can instead be employed to determine the quantitative amplitude irreversibility -- a novel parameter proposed in this paper for nonequilibrium calculated by means of the probabilistic difference in amplitude fluctuations.

Extension of causal decomposition in the mutual complex dynamic process

no code implementations17 Aug 2020 Yi Zhang, Qin Yang, Lifu Zhang, Branko Celler, Steven Su, Peng Xu, Dezhong Yao

Causal decomposition depicts a cause-effect relationship that is not based on the concept of prediction, but based on the phase dependence of time series.

Time Series Time Series Analysis

Self-Paced Multi-Task Clustering

1 code implementation24 Aug 2018 Yazhou Ren, Xiaofan Que, Dezhong Yao, Zenglin Xu

Despite the success of traditional MTC models, they are either easy to stuck into local optima, or sensitive to outliers and noisy data.

Clustering

The Best of Both Worlds: Combining Data-independent and Data-driven Approaches for Action Recognition

no code implementations17 May 2015 Zhenzhong Lan, Dezhong Yao, Ming Lin, Shoou-I Yu, Alexander Hauptmann

First, we propose a two-stream Stacked Convolutional Independent Subspace Analysis (ConvISA) architecture to show that unsupervised learning methods can significantly boost the performance of traditional local features extracted from data-independent models.

Action Recognition Multi-class Classification +3

Human mobility synthesis using matrix and tensor factorizations

no code implementations Information Fusion 2014 Dezhong Yao, Chen Yu, Hai Jin, Qiang Ding

As the tensor model has a strong ability to describe high-dimensional information, we propose an algorithm to predict human mobility in tensors of location context data.

Management Tensor Decomposition

Cannot find the paper you are looking for? You can Submit a new open access paper.