Search Results for author: Song Guo

Found 79 papers, 14 papers with code

EmInspector: Combating Backdoor Attacks in Federated Self-Supervised Learning Through Embedding Inspection

1 code implementation21 May 2024 Yuwen Qian, Shuchi Wu, Kang Wei, Ming Ding, Di Xiao, Tao Xiang, Chuan Ma, Song Guo

To tackle this issue, we dive into the fundamental mechanism of backdoor attacks on FSSL, proposing the Embedding Inspector (EmInspector) that detects malicious clients by inspecting the embedding space of local models.

Backdoor Attack Self-Supervised Learning

CRA5: Extreme Compression of ERA5 for Portable Global Climate and Weather Research via an Efficient Variational Transformer

no code implementations6 May 2024 Tao Han, Zhenghao Chen, Song Guo, Wanghan Xu, Lei Bai

To mitigate this issue, we introduce an efficient neural codec, the Variational Autoencoder Transformer (VAEformer), for extreme compression of climate data to significantly reduce data storage cost, making AI-based meteorological research portable to researchers.

Weather Forecasting

Source Prompt Disentangled Inversion for Boosting Image Editability with Diffusion Models

1 code implementation17 Mar 2024 Ruibin Li, Ruihuang Li, Song Guo, Lei Zhang

Text-driven diffusion models have significantly advanced the image editing performance by using text prompts as inputs.

Image Generation

DiPrompT: Disentangled Prompt Tuning for Multiple Latent Domain Generalization in Federated Learning

no code implementations CVPR 2024 Sikai Bai, Jie Zhang, Shuaicheng Li, Song Guo, Jingcai Guo, Jun Hou, Tao Han, Xiaocheng Lu

Federated learning (FL) has emerged as a powerful paradigm for learning from decentralized data, and federated domain generalization further considers the test dataset (target domain) is absent from the decentralized training data (source domains).

Domain Generalization Federated Learning +1

EBFT: Effective and Block-Wise Fine-Tuning for Sparse LLMs

1 code implementation19 Feb 2024 Song Guo, Fan Wu, Lei Zhang, Xiawu Zheng, Shengchuan Zhang, Fei Chao, Yiyu Shi, Rongrong Ji

For instance, on the Wikitext2 dataset with LlamaV1-7B at 70% sparsity, our proposed EBFT achieves a perplexity of 16. 88, surpassing the state-of-the-art DSnoT with a perplexity of 75. 14.

C2KD: Bridging the Modality Gap for Cross-Modal Knowledge Distillation

no code implementations CVPR 2024 Fushuo Huo, Wenchao Xu, Jingcai Guo, Haozhao Wang, Song Guo

We empirically reveal that the modality gap i. e. modality imbalance and soft label misalignment incurs the ineffectiveness of traditional KD in CMKD.

Knowledge Distillation Transfer Learning

Balanced Multi-modal Federated Learning via Cross-Modal Infiltration

no code implementations31 Dec 2023 Yunfeng Fan, Wenchao Xu, Haozhao Wang, Jiaqi Zhu, Song Guo

Federated learning (FL) underpins advancements in privacy-preserving distributed computing by collaboratively training neural networks without exposing clients' raw data.

Distributed Computing Federated Learning +2

Client-wise Modality Selection for Balanced Multi-modal Federated Learning

no code implementations31 Dec 2023 Yunfeng Fan, Wenchao Xu, Haozhao Wang, Penghui Ruan, Song Guo

Selecting proper clients to participate in the iterative federated learning (FL) rounds is critical to effectively harness a broad range of distributed datasets.

Federated Learning Selection bias

Mobility and Cost Aware Inference Accelerating Algorithm for Edge Intelligence

no code implementations27 Dec 2023 Xin Yuan, Ning li, Kang Wei, Wenchao Xu, Quan Chen, Hao Chen, Song Guo

The model segmentation without user mobility has been investigated deeply by previous works.

Segmentation

High Efficiency Inference Accelerating Algorithm for NOMA-based Mobile Edge Computing

no code implementations26 Dec 2023 Xin Yuan, Ning li, Tuo Zhang, Muqing Li, YuWen Chen, Jose Fernan Martinez Ortega, Song Guo

Specifically, when the mobile user has a large model inference task needed to be calculated in the NOMA-based MEC, it will take the energy consumption of both device and edge server and the inference latency into account to find the optimal model split strategy, subchannel allocation strategy (uplink and downlink), and transmission power allocation strategy (uplink and downlink).

Edge-computing

QuickDrop: Efficient Federated Unlearning by Integrated Dataset Distillation

no code implementations27 Nov 2023 Akash Dhasade, Yaohong Ding, Song Guo, Anne-Marie Kermarrec, Martijn de Vos, Leijie Wu

We introduce QuickDrop, an efficient and original FU method that utilizes dataset distillation (DD) to accelerate unlearning and drastically reduces computational overhead compared to existing approaches.

Federated Learning

FreePIH: Training-Free Painterly Image Harmonization with Diffusion Model

no code implementations25 Nov 2023 Ruibin Li, Jingcai Guo, Song Guo, Qihua Zhou, Jie Zhang

Specifically, we find that the very last few steps of the denoising (i. e., generation) process strongly correspond to the stylistic information of images, and based on this, we propose to augment the latent features of both the foreground and background images with Gaussians for a direct denoising-based harmonization.

Denoising Image Harmonization +1

Attribute-Aware Representation Rectification for Generalized Zero-Shot Learning

no code implementations23 Nov 2023 Zhijie Rao, Jingcai Guo, Xiaocheng Lu, Qihua Zhou, Jie Zhang, Kang Wei, Chenxin Li, Song Guo

In this paper, we propose a simple yet effective Attribute-Aware Representation Rectification framework for GZSL, dubbed $\mathbf{(AR)^{2}}$, to adaptively rectify the feature extractor to learn novel features while keeping original valuable features.

Attribute Generalized Zero-Shot Learning +1

A Survey on Trustworthy Edge Intelligence: From Security and Reliability To Transparency and Sustainability

no code implementations27 Oct 2023 Xiaojie Wang, Beibei Wang, Yu Wu, Zhaolong Ning, Song Guo, Fei Richard Yu

Edge Intelligence (EI) integrates Edge Computing (EC) and Artificial Intelligence (AI) to push the capabilities of AI to the network edge for real-time, efficient and secure intelligent decision-making and computation.

Decision Making Edge-computing

Federated Meta-Learning for Few-Shot Fault Diagnosis with Representation Encoding

no code implementations13 Oct 2023 Jixuan Cui, Jun Li, Zhen Mei, Kang Wei, Sha Wei, Ming Ding, Wen Chen, Song Guo

However, the domain discrepancy and data scarcity problems among clients deteriorate the performance of the global FL model.

Federated Learning Meta-Learning +1

Compresso: Structured Pruning with Collaborative Prompting Learns Compact Large Language Models

1 code implementation8 Oct 2023 Song Guo, Jiahang Xu, Li Lyna Zhang, Mao Yang

To this end, Compresso prunes LLaMA-7B to 5. 4B, maintaining original performance and even surpassing LLaMA-7B in reading comprehension by 2. 62%.

Natural Language Understanding Reading Comprehension

GBE-MLZSL: A Group Bi-Enhancement Framework for Multi-Label Zero-Shot Learning

no code implementations2 Sep 2023 Ziming Liu, Jingcai Guo, Xiaocheng Lu, Song Guo, Peiran Dong, Jiewei Zhang

That is, in the process of inferring unseen classes, global features represent the principal direction of the image in the feature space, while local features should maintain uniqueness within a certain range.

Multi-label zero-shot learning

Intelligence-Endogenous Management Platform for Computing and Network Convergence

no code implementations7 Aug 2023 Zicong Hong, Xiaoyu Qiu, Jian Lin, Wuhui Chen, Yue Yu, Hui Wang, Song Guo, Wen Gao

Therefore, in this article, we present the concept of an intelligence-endogenous management platform for CNCs called \emph{CNC brain} based on artificial intelligence technologies.

Management Scheduling

Adaptive DNN Surgery for Selfish Inference Acceleration with On-demand Edge Resource

no code implementations21 Jun 2023 Xiang Yang, Dezhi Chen, Qi Qi, Jingyu Wang, Haifeng Sun, Jianxin Liao, Song Guo

Deep Neural Networks (DNNs) have significantly improved the accuracy of intelligent applications on mobile devices.

Edge-computing

On Knowledge Editing in Federated Learning: Perspectives, Challenges, and Future Directions

no code implementations2 Jun 2023 Leijie Wu, Song Guo, Junxiao Wang, Zicong Hong, Jie Zhang, Jingren Zhou

As Federated Learning (FL) has gained increasing attention, it has become widely acknowledged that straightforwardly applying stochastic gradient descent (SGD) on the overall framework when learning over a sequence of tasks results in the phenomenon known as ``catastrophic forgetting''.

Federated Learning knowledge editing

Dissecting Arbitrary-scale Super-resolution Capability from Pre-trained Diffusion Generative Models

no code implementations1 Jun 2023 Ruibin Li, Qihua Zhou, Song Guo, Jie Zhang, Jingcai Guo, Xinyang Jiang, Yifei Shen, Zhenhua Han

Diffusion-based Generative Models (DGMs) have achieved unparalleled performance in synthesizing high-quality visual content, opening up the opportunity to improve image super-resolution (SR) tasks.

Image Super-Resolution

SFP: Spurious Feature-targeted Pruning for Out-of-Distribution Generalization

no code implementations19 May 2023 Yingchun Wang, Jingcai Guo, Yi Liu, Song Guo, Weizhan Zhang, Xiangyong Cao, Qinghua Zheng

Based on the idea that in-distribution (ID) data with spurious features may have a lower experience risk, in this paper, we propose a novel Spurious Feature-targeted model Pruning framework, dubbed SFP, to automatically explore invariant substructures without referring to the above drawbacks.

Out-of-Distribution Generalization

MDENet: Multi-modal Dual-embedding Networks for Malware Open-set Recognition

no code implementations2 May 2023 Jingcai Guo, Yuanyuan Xu, Wenchao Xu, Yufeng Zhan, Yuxia Sun, Song Guo

Malware open-set recognition (MOSR) aims at jointly classifying malware samples from known families and detect the ones from novel unknown families, respectively.

Open Set Learning

CNS-Net: Conservative Novelty Synthesizing Network for Malware Recognition in an Open-set Scenario

1 code implementation2 May 2023 Jingcai Guo, Song Guo, Shiheng Ma, Yuxia Sun, Yuanyuan Xu

Previous works usually assume the malware families are known to the classifier in a close-set scenario, i. e., testing families are the subset or at most identical to training families.

Open Set Learning

Towards Unbiased Training in Federated Open-world Semi-supervised Learning

no code implementations1 May 2023 Jie Zhang, Xiaosong Ma, Song Guo, Wenchao Xu

Federated Semi-supervised Learning (FedSSL) has emerged as a new paradigm for allowing distributed clients to collaboratively train a machine learning model over scarce labeled data and abundant unlabeled data.

Open-World Semi-Supervised Learning Transfer Learning

Non-Exemplar Online Class-incremental Continual Learning via Dual-prototype Self-augment and Refinement

no code implementations20 Mar 2023 Fushuo Huo, Wenchao Xu, Jingcai Guo, Haozhao Wang, Yunfeng Fan, Song Guo

In this paper, we propose a novel Dual-prototype Self-augment and Refinement method (DSR) for NO-CL problem, which consists of two strategies: 1) Dual class prototypes: vanilla and high-dimensional prototypes are exploited to utilize the pre-trained information and obtain robust quasi-orthogonal representations rather than example buffers for both privacy preservation and memory reduction.

Continual Learning

DualMix: Unleashing the Potential of Data Augmentation for Online Class-Incremental Learning

no code implementations14 Mar 2023 Yunfeng Fan, Wenchao Xu, Haozhao Wang, Jiaqi Zhu, Junxiao Wang, Song Guo

Unfortunately, OCI learning can suffer from catastrophic forgetting (CF) as the decision boundaries for old classes can become inaccurate when perturbated by new ones.

Class Incremental Learning Data Augmentation +1

Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge Models

no code implementations9 Feb 2023 Yingchun Wang, Jingcai Guo, Jie Zhang, Song Guo, Weizhan Zhang, Qinghua Zheng

Federated learning (FL) is an emerging technique that trains massive and geographically distributed edge data while maintaining privacy.

Computational Efficiency Fairness +1

Data Quality-aware Mixed-precision Quantization via Hybrid Reinforcement Learning

no code implementations9 Feb 2023 Yingchun Wang, Jingcai Guo, Song Guo, Weizhan Zhang

Mixed-precision quantization mostly predetermines the model bit-width settings before actual training due to the non-differential bit-width sampling process, obtaining sub-optimal performance.

Quantization reinforcement-learning +1

(ML)$^2$P-Encoder: On Exploration of Channel-Class Correlation for Multi-Label Zero-Shot Learning

no code implementations CVPR 2023 Ziming Liu, Song Guo, Xiaocheng Lu, Jingcai Guo, Jiewei Zhang, Yue Zeng, Fushuo Huo

Recent studies usually approach multi-label zero-shot learning (MLZSL) with visual-semantic mapping on spatial-class correlation, which can be computationally costly, and worse still, fails to capture fine-grained class-specific semantics.

Multi-label zero-shot learning

Automatic Network Pruning via Hilbert-Schmidt Independence Criterion Lasso under Information Bottleneck Principle

1 code implementation ICCV 2023 Song Guo, Lei Zhang, Xiawu Zheng, Yan Wang, Yuchao Li, Fei Chao, Chenglin Wu, Shengchuan Zhang, Rongrong Ji

In this paper, we try to solve this problem by introducing a principled and unified framework based on Information Bottleneck (IB) theory, which further guides us to an automatic pruning approach.

Network Pruning

Exploring Optimal Substructure for Out-of-distribution Generalization via Feature-targeted Model Pruning

no code implementations19 Dec 2022 Yingchun Wang, Jingcai Guo, Song Guo, Weizhan Zhang, Jie Zhang

Recent studies show that even highly biased dense networks contain an unbiased substructure that can achieve better out-of-distribution (OOD) generalization than the original model.

Out-of-Distribution Generalization

Efficient Stein Variational Inference for Reliable Distribution-lossless Network Pruning

no code implementations7 Dec 2022 Yingchun Wang, Song Guo, Jingcai Guo, Weizhan Zhang, Yida Xu, Jie Zhang, Yi Liu

Extensive experiments based on small Cifar-10 and large-scaled ImageNet demonstrate that our method can obtain sparser networks with great generalization performance while providing quantified reliability for the pruned model.

Network Pruning Variational Inference

Exploiting Personalized Invariance for Better Out-of-distribution Generalization in Federated Learning

no code implementations21 Nov 2022 Xueyang Tang, Song Guo, Jie Zhang

Recently, data heterogeneity among the training datasets on the local clients (a. k. a., Non-IID data) has attracted intense interest in Federated Learning (FL), and many personalized federated learning methods have been proposed to handle it.

Out-of-Distribution Generalization Personalized Federated Learning

Decomposed Soft Prompt Guided Fusion Enhancing for Compositional Zero-Shot Learning

1 code implementation CVPR 2023 Xiaocheng Lu, Ziming Liu, Song Guo, Jingcai Guo

Existing methods either learn the combined state-object representation, challenging the generalization of unseen compositions, or design two classifiers to identify state and object separately from image features, ignoring the intrinsic relationship between them.

Compositional Zero-Shot Learning Novel Concepts +1

ProCC: Progressive Cross-primitive Compatibility for Open-World Compositional Zero-Shot Learning

no code implementations19 Nov 2022 Fushuo Huo, Wenchao Xu, Song Guo, Jingcai Guo, Haozhao Wang, Ziming Liu, Xiaocheng Lu

Open-World Compositional Zero-shot Learning (OW-CZSL) aims to recognize novel compositions of state and object primitives in images with no priors on the compositional space, which induces a tremendously large output space containing all possible state-object compositions.

Compositional Zero-Shot Learning Object

CaDM: Codec-aware Diffusion Modeling for Neural-enhanced Video Streaming

no code implementations15 Nov 2022 Qihua Zhou, Ruibin Li, Song Guo, Peiran Dong, Yi Liu, Jingcai Guo, Zhenda Xu

Recent years have witnessed the dramatic growth of Internet video traffic, where the video bitstreams are often compressed and delivered in low quality to fit the streamer's uplink bandwidth.

Decoder Denoising +1

FedTune: A Deep Dive into Efficient Federated Fine-Tuning with Pre-trained Transformers

no code implementations15 Nov 2022 Jinyu Chen, Wenchao Xu, Song Guo, Junxiao Wang, Jie Zhang, Haozhao Wang

Federated Learning (FL) is an emerging paradigm that enables distributed users to collaboratively and iteratively train machine learning models without sharing their private data.

Federated Learning Language Modelling +1

PMR: Prototypical Modal Rebalance for Multimodal Learning

no code implementations CVPR 2023 Yunfeng Fan, Wenchao Xu, Haozhao Wang, Junxiao Wang, Song Guo

Multimodal learning (MML) aims to jointly exploit the common priors of different modalities to compensate for their inherent limitations.

Feature Correlation-guided Knowledge Transfer for Federated Self-supervised Learning

no code implementations14 Nov 2022 Yi Liu, Song Guo, Jie Zhang, Qihua Zhou, Yingchun Wang, Xiaohan Zhao

We prove that FedFoA is a model-agnostic training framework and can be easily compatible with state-of-the-art unsupervised FL methods.

Feature Correlation Federated Learning +4

Demystify Self-Attention in Vision Transformers from a Semantic Perspective: Analysis and Application

no code implementations13 Nov 2022 Leijie Wu, Song Guo, Yaohong Ding, Junxiao Wang, Wenchao Xu, Richard Yida Xu, Jie Zhang

In contrast, visual data exhibits a fundamentally different structure: Its basic unit (pixel) is a natural low-level representation with significant redundancies in the neighbourhood, which poses obvious challenges to the interpretability of MSA mechanism in ViT.

PromptFL: Let Federated Participants Cooperatively Learn Prompts Instead of Models -- Federated Learning in Age of Foundation Model

no code implementations24 Aug 2022 Tao Guo, Song Guo, Junxiao Wang, Wenchao Xu

Quick global aggregation of effective distributed parameters is crucial to federated learning (FL), which requires adequate bandwidth for parameters communication and sufficient user data for local training.

Federated Learning

Fed-FSNet: Mitigating Non-I.I.D. Federated Learning via Fuzzy Synthesizing Network

no code implementations21 Aug 2022 Jingcai Guo, Song Guo, Jie Zhang, Ziming Liu

Concretely, we maintain an edge-agnostic hidden model in the cloud server to estimate a less-accurate while direction-aware inversion of the global model.

Federated Learning Privacy Preserving

A Survey on Collaborative DNN Inference for Edge Intelligence

no code implementations16 Jul 2022 Weiqing Ren, Yuben Qu, Chao Dong, Yuqian Jing, Hao Sun, Qihui Wu, Song Guo

With the vigorous development of artificial intelligence (AI), the intelligent applications based on deep neural network (DNN) change people's lifestyles and the production efficiency.

A Survey on Gradient Inversion: Attacks, Defenses and Future Directions

no code implementations15 Jun 2022 Rui Zhang, Song Guo, Junxiao Wang, Xin Xie, DaCheng Tao

In particular, we dig out some critical ingredients from the iteration-based attacks, including data initialization, model training and gradient matching.

Anchor Sampling for Federated Learning with Partial Client Participation

1 code implementation13 Jun 2022 Feijie Wu, Song Guo, Zhihao Qu, Shiqi He, Ziming Liu, Jing Gao

The lack of inactive clients' updates in partial client participation makes it more likely for the model aggregation to deviate from the aggregation based on full client participation.

Federated Learning

CE-based white-box adversarial attacks will not work using super-fitting

no code implementations4 May 2022 Youhuan Yang, Lei Sun, Leyu Dai, Song Guo, Xiuqing Mao, Xiaoqin Wang, Bayi Xu

This is especially dangerous for some systems with high-security requirements, so this paper proposes a new defense method by using the model super-fitting state to improve the model's adversarial robustness (i. e., the accuracy under adversarial attacks).

Adversarial Attack Adversarial Robustness

Rethinking Classifier and Adversarial Attack

no code implementations4 May 2022 Youhuan Yang, Lei Sun, Leyu Dai, Song Guo, Xiuqing Mao, Xiaoqin Wang, Bayi Xu

Various defense models have been proposed to resist adversarial attack algorithms, but existing adversarial robustness evaluation methods always overestimate the adversarial robustness of these models (i. e., not approaching the lower bound of robustness).

Adversarial Attack Adversarial Robustness

Sign Bit is Enough: A Learning Synchronization Framework for Multi-hop All-reduce with Ultimate Compression

no code implementations14 Apr 2022 Feijie Wu, Shiqi He, Song Guo, Zhihao Qu, Haozhao Wang, Weihua Zhuang, Jie Zhang

Traditional one-bit compressed stochastic gradient descent can not be directly employed in multi-hop all-reduce, a widely adopted distributed training paradigm in network-intensive high-performance computing systems such as public clouds.

Towards Unbiased Multi-label Zero-Shot Learning with Pyramid and Semantic Attention

no code implementations7 Mar 2022 Ziming Liu, Song Guo, Jingcai Guo, Yuanyuan Xu, Fushuo Huo

We argue that disregarding the connection between major and minor classes, i. e., correspond to the global and local information, respectively, is the cause of the problem.

Multi-label zero-shot learning

Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representations

no code implementations27 Feb 2022 Tao Guo, Song Guo, Jiewei Zhang, Wenchao Xu, Junxiao Wang

Existing studies of machine unlearning mainly focus on sample-wise unlearning, such that a learnt model will not expose user's privacy at the sample level.

Attribute Face Recognition +2

A Coalition Formation Game Approach for Personalized Federated Learning

no code implementations5 Feb 2022 Leijie Wu, Song Guo, Yaohong Ding, Yufeng Zhan, Jie Zhang

Facing the challenge of statistical diversity in client local data distribution, personalized federated learning (PFL) has become a growing research hotspot.

Personalized Federated Learning

From Deterioration to Acceleration: A Calibration Approach to Rehabilitating Step Asynchronism in Federated Optimization

1 code implementation17 Dec 2021 Feijie Wu, Song Guo, Haozhao Wang, Zhihao Qu, Haobo Zhang, Jie Zhang, Ziming Liu

In the setting of federated optimization, where a global model is aggregated periodically, step asynchronism occurs when participants conduct model training by efficiently utilizing their computational resources.

Parameterized Knowledge Transfer for Personalized Federated Learning

1 code implementation NeurIPS 2021 Jie Zhang, Song Guo, Xiaosong Ma, Haozhao Wang, Wencao Xu, Feijie Wu

To deal with such model constraints, we exploit the potentials of heterogeneous model settings and propose a novel training framework to employ personalized models for different clients.

Personalized Federated Learning Transfer Learning

Federated Unlearning via Class-Discriminative Pruning

no code implementations22 Oct 2021 Junxiao Wang, Song Guo, Xin Xie, Heng Qi

Evaluated on CIFAR10 dataset, our method accelerates the speed of unlearning by 8. 9x for the ResNet model, and 7. 9x for the VGG model under no degradation in accuracy, compared to retraining from scratch.

Federated Learning Image Classification

SDN-based Resource Allocation in Edge and Cloud Computing Systems: An Evolutionary Stackelberg Differential Game Approach

no code implementations26 Sep 2021 Jun Du, Chunxiao Jiang, Abderrahim Benslimane, Song Guo, Yong Ren

Based on this dynamic access model, a Stackelberg differential game based cloud computing resource sharing mechanism is proposed to facilitate the resource trading between the cloud computing service provider (CCP) and different edge computing service providers (ECPs).

Cloud Computing Edge-computing +1

Personalized Federated Learning with Contextualized Generalization

no code implementations24 Jun 2021 Xueyang Tang, Song Guo, Jingcai Guo

The prevalent personalized federated learning (PFL) usually pursues a trade-off between personalization and generalization by maintaining a shared global model to guide the training process of local models.

Personalized Federated Learning

Decentralized Federated Learning for UAV Networks: Architecture, Challenges, and Opportunities

no code implementations15 Apr 2021 Yuben Qu, Haipeng Dai, Yan Zhuang, Jiafa Chen, Chao Dong, Fan Wu, Song Guo

Unmanned aerial vehicles (UAVs), or say drones, are envisioned to support extensive applications in next-generation wireless networks in both civil and military fields.

Federated Learning

Online Multiple Object Tracking with Cross-Task Synergy

1 code implementation CVPR 2021 Song Guo, Jingya Wang, Xinchao Wang, DaCheng Tao

On the other hand, such reliable embeddings can boost identity-awareness through memory aggregation, hence strengthen attention modules and suppress drifts.

Multiple Object Tracking Object +1

DPN: Detail-Preserving Network with High Resolution Representation for Efficient Segmentation of Retinal Vessels

2 code implementations25 Sep 2020 Song Guo

2) The segmentation speed of DPN is over 20-160 times faster than other methods on the DRIVE dataset.

Decoder Segmentation

Scalable and Communication-efficient Decentralized Federated Edge Learning with Multi-blockchain Framework

no code implementations10 Aug 2020 Jiawen Kang, Zehui Xiong, Chunxiao Jiang, Yi Liu, Song Guo, Yang Zhang, Dusit Niyato, Cyril Leung, Chunyan Miao

This framework can achieve scalable and flexible decentralized FEL by individually manage local model updates or model sharing records for performance isolation.

Cryptography and Security

A Novel Perspective to Zero-shot Learning: Towards an Alignment of Manifold Structures via Semantic Feature Expansion

no code implementations30 Apr 2020 Jingcai Guo, Song Guo

One common practice in zero-shot learning is to train a projection between the visual and semantic feature spaces with labeled seen classes examples.

Attribute Zero-Shot Learning

Prophet: Proactive Candidate-Selection for Federated Learning by Predicting the Qualities of Training and Reporting Phases

no code implementations3 Feb 2020 Huawei Huang, Kangying Lin, Song Guo, Pan Zhou, Zibin Zheng

In the dynamic environment, the mobile devices selected by the existing reactive candidate-selection algorithms very possibly fail to complete the training and reporting phases of FL, because the FL parameter server only knows the currently-observed resources of all candidates.

Federated Learning

Intermittent Pulling with Local Compensation for Communication-Efficient Federated Learning

no code implementations22 Jan 2020 Haozhao Wang, Zhihao Qu, Song Guo, Xin Gao, Ruixuan Li, Baoliu Ye

A major bottleneck on the performance of distributed Stochastic Gradient Descent (SGD) algorithm for large-scale Federated Learning is the communication overhead on pushing local gradients and pulling global model.

BIG-bench Machine Learning Federated Learning

PIRATE: A Blockchain-based Secure Framework of Distributed Machine Learning in 5G Networks

no code implementations17 Dec 2019 Sicong Zhou, Huawei Huang, Wuhui Chen, Zibin Zheng, Song Guo

Therefore, to provide the byzantine-resilience for distributed learning in 5G era, this article proposes a secure computing framework based on the sharding-technique of blockchain, namely PIRATE.

Distributed, Parallel, and Cluster Computing Cryptography and Security

Deep Learning for Physical-Layer 5G Wireless Techniques: Opportunities, Challenges and Solutions

no code implementations21 Apr 2019 Hongji Huang, Song Guo, Guan Gui, Zhen Yang, Jianhua Zhang, Hikmet Sari, Fumiyuki Adachi

The new demands for high-reliability and ultra-high capacity wireless communication have led to extensive research into 5G communications.

MAANet: Multi-view Aware Attention Networks for Image Super-Resolution

1 code implementation12 Apr 2019 Jingcai Guo, Shiheng Ma, Song Guo

Specifically, we propose the local aware (LA) and global aware (GA) attention to deal with LR features in unequal manners, which can highlight the high-frequency components and discriminate each feature from LR images in the local and the global views, respectively.

Image Super-Resolution

Position-Aware Convolutional Networks for Traffic Prediction

no code implementations12 Apr 2019 Shiheng Ma, Jingcai Guo, Song Guo, Minyi Guo

Our approach employs the inception backbone network to capture rich features of traffic distribution on the whole area.

Management Position +1

Adaptive Adjustment with Semantic Feature Space for Zero-Shot Recognition

no code implementations30 Mar 2019 Jingcai Guo, Song Guo

To the best of our knowledge, our work is the first to consider the adaptive adjustment of semantic FS in ZSR.

Zero-Shot Learning

EE-AE: An Exclusivity Enhanced Unsupervised Feature Learning Approach

no code implementations30 Mar 2019 Jingcai Guo, Song Guo

In order to deal with this issue, we propose an Exclusivity Enhanced (EE) unsupervised feature learning approach to improve the conventional AE.

Decoder

Gradient Scheduling with Global Momentum for Non-IID Data Distributed Asynchronous Training

no code implementations21 Feb 2019 Chengjie Li, Ruixuan Li, Haozhao Wang, Yuhua Li, Pan Zhou, Song Guo, Keqin Li

Distributed asynchronous offline training has received widespread attention in recent years because of its high performance on large-scale data and complex models.

Scheduling

BTS-DSN: Deeply Supervised Neural Network with Short Connections for Retinal Vessel Segmentation

1 code implementation11 Mar 2018 Song Guo, Kai Wang, Hong Kang, Yujun Zhang, Yingqi Gao, Tao Li

Results: The proposed BTS-DSN has been verified on DRIVE, STARE and CHASE_DB1 datasets, and showed competitive performance over other state-of-the-art methods.

Retinal Vessel Segmentation Segmentation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.