Search Results for author: Ziyue Huang

Found 12 papers, 3 papers with code

Heterogeneous Federated Learning with Splited Language Model

no code implementations24 Mar 2024 Yifan Shi, Yuhui Zhang, Ziyue Huang, Xiaofeng Yang, Li Shen, Wei Chen, Xueqian Wang

Federated Split Learning (FSL) is a promising distributed learning paradigm in practice, which gathers the strengths of both Federated Learning (FL) and Split Learning (SL) paradigms, to ensure model privacy while diminishing the resource overhead of each client, especially on large transformer models in a resource-constrained environment, e. g., Internet of Things (IoT).

Federated Learning Language Modelling

Generic Knowledge Boosted Pre-training For Remote Sensing Images

1 code implementation9 Jan 2024 Ziyue Huang, Mingming Zhang, Yuan Gong, Qingjie Liu, Yunhong Wang

Deep learning models are essential for scene classification, change detection, land cover segmentation, and other remote sensing image understanding tasks.

Change Detection General Knowledge +4

DUA-DA: Distillation-based Unbiased Alignment for Domain Adaptive Object Detection

no code implementations17 Nov 2023 Yongchao Feng, Shiwei Li, Yingjie Gao, Ziyue Huang, Yanan Zhang, Qingjie Liu, Yunhong Wang

Though feature-alignment based Domain Adaptive Object Detection (DAOD) have achieved remarkable progress, they ignore the source bias issue, i. e. the aligned features are more favorable towards the source domain, leading to a sub-optimal adaptation.

Classification object-detection +2

Incremental Object Detection with CLIP

no code implementations13 Oct 2023 Yupeng He, Ziyue Huang, Qingjie Liu, Yunhong Wang

In the incremental detection task, unlike the incremental classification task, data ambiguity exists due to the possibility of an image having different labeled bounding boxes in multiple continuous learning stages.

Class-Incremental Object Detection Incremental Learning +3

Context-Enhanced Detector For Building Detection From Remote Sensing Images

no code implementations11 Oct 2023 Ziyue Huang, Mingming Zhang, Qingjie Liu, Wei Wang, Zhe Dong, Yunhong Wang

Our approach utilizes a three-stage cascade structure to enhance the extraction of contextual information and improve building detection accuracy.

Semantic Segmentation

Gate Recurrent Unit Network based on Hilbert-Schmidt Independence Criterion for State-of-Health Estimation

no code implementations16 Mar 2023 Ziyue Huang, Lujuan Dang, Yuqing Xie, Wentao Ma, Badong Chen

State-of-health (SOH) estimation is a key step in ensuring the safe and reliable operation of batteries.

SeqPATE: Differentially Private Text Generation via Knowledge Distillation

no code implementations29 Sep 2021 Zhiliang Tian, Yingxiu Zhao, Ziyue Huang, Yu-Xiang Wang, Nevin Zhang, He He

Differentially private (DP) learning algorithms provide guarantees on identifying the existence of a training sample from model outputs.

Knowledge Distillation Sentence +2

Frequency Estimation Under Multiparty Differential Privacy: One-shot and Streaming

no code implementations5 Apr 2021 Ziyue Huang, Yuan Qiu, Ke Yi, Graham Cormode

We study the fundamental problem of frequency estimation under both privacy and communication constraints, where the data is distributed among $k$ parties.

Optimal Sparsity-Sensitive Bounds for Distributed Mean Estimation

1 code implementation NeurIPS 2019 Zengfeng Huang, Ziyue Huang, Yilei Wang, Ke Yi

We consider the problem of estimating the mean of a set of vectors, which are stored in a distributed system.

Communication-Efficient Weighted Sampling and Quantile Summary for GBDT

no code implementations17 Sep 2019 Ziyue Huang, Ke Yi

Gradient boosting decision tree (GBDT) is a powerful and widely-used machine learning model, which has achieved state-of-the-art performance in many academic areas and production environment.

BIG-bench Machine Learning

Communication-Efficient Distributed Blockwise Momentum SGD with Error-Feedback

1 code implementation NeurIPS 2019 Shuai Zheng, Ziyue Huang, James T. Kwok

In particular, on distributed ResNet training with 7 workers on the ImageNet, the proposed algorithm achieves the same testing accuracy as momentum SGD using full-precision gradients, but with $46\%$ less wall clock time.

Quantization

Cannot find the paper you are looking for? You can Submit a new open access paper.