Search Results for author: Yonggang Wen

Found 40 papers, 14 papers with code

Optimizing Performance of Federated Person Re-identification: Benchmarking and Analysis

no code implementations24 May 2022 Weiming Zhuang, Xin Gan, Yonggang Wen, Shuai Zhang

Based on these insights, we propose three optimization approaches: (1) We adopt knowledge distillation to facilitate the convergence of FedReID by better transferring knowledge from clients to the server; (2) We introduce client clustering to improve the performance of large datasets by aggregating clients with similar data distributions; (3) We propose cosine distance weight to elevate performance by dynamically updating the weights for aggregation depending on how well models are trained in clients.

Federated Learning Knowledge Distillation +1

Divergence-aware Federated Self-Supervised Learning

no code implementations ICLR 2022 Weiming Zhuang, Yonggang Wen, Shuai Zhang

Using the framework, our study uncovers unique insights of FedSSL: 1) stop-gradient operation, previously reported to be essential, is not always necessary in FedSSL; 2) retaining local knowledge of clients in FedSSL is particularly beneficial for non-IID data.

Federated Learning Self-Supervised Learning

Characterization and Prediction of Deep Learning Workloads in Large-Scale GPU Datacenters

1 code implementation3 Sep 2021 Qinghao Hu, Peng Sun, Shengen Yan, Yonggang Wen, Tianwei Zhang

Modern GPU datacenters are critical for delivering Deep Learning (DL) models and services in both the research community and industry.

Collaborative Unsupervised Visual Representation Learning from Decentralized Data

no code implementations ICCV 2021 Weiming Zhuang, Xin Gan, Yonggang Wen, Shuai Zhang, Shuai Yi

In this framework, each party trains models from unlabeled data independently using contrastive learning with an online network and a target network.

Contrastive Learning Representation Learning

Joint Optimization in Edge-Cloud Continuum for Federated Unsupervised Person Re-identification

no code implementations14 Aug 2021 Weiming Zhuang, Yonggang Wen, Shuai Zhang

We present FedUReID, a federated unsupervised person ReID system to learn person ReID models without any labels while preserving privacy.

Federated Learning Unsupervised Person Re-Identification

Are Missing Links Predictable? An Inferential Benchmark for Knowledge Graph Completion

1 code implementation ACL 2021 Yixin Cao, Xiang Ji, Xin Lv, Juanzi Li, Yonggang Wen, Hanwang Zhang

We present InferWiki, a Knowledge Graph Completion (KGC) dataset that improves upon existing benchmarks in inferential ability, assumptions, and patterns.

Knowledge Graph Completion

ModelPS: An Interactive and Collaborative Platform for Editing Pre-trained Models at Scale

1 code implementation18 May 2021 Yuanming Li, Huaizheng Zhang, Shanshan Jiang, Fan Yang, Yonggang Wen, Yong Luo

AI engineering has emerged as a crucial discipline to democratize deep neural network (DNN) models among software developers with a diverse background.

EasyFL: A Low-code Federated Learning Platform For Dummies

no code implementations17 May 2021 Weiming Zhuang, Xin Gan, Yonggang Wen, Shuai Zhang

However, these platforms are complex to use and require a deep understanding of FL, which imposes high barriers to entry for beginners, limits the productivity of researchers, and compromises deployment efficiency.

Federated Learning Privacy Preserving

Towards Unsupervised Domain Adaptation for Deep Face Recognition under Privacy Constraints via Federated Learning

no code implementations17 May 2021 Weiming Zhuang, Xin Gan, Yonggang Wen, Xuesen Zhang, Shuai Zhang, Shuai Yi

To this end, FedFR forms an end-to-end training pipeline: (1) pre-train in the source domain; (2) predict pseudo labels by clustering in the target domain; (3) conduct domain-constrained federated learning across two domains.

Face Recognition Federated Learning +1

A Serverless Cloud-Fog Platform for DNN-Based Video Analytics with Incremental Learning

no code implementations5 Feb 2021 Huaizheng Zhang, Meng Shen, Yizheng Huang, Yonggang Wen, Yong Luo, Guanyu Gao, Kyle Guan

To save bandwidth and reduce RTT, VPaaS provides a new video streaming protocol that only sends low-quality video to the cloud.

Incremental Learning

On the Practicality of Differential Privacy in Federated Learning by Tuning Iteration Times

no code implementations11 Jan 2021 Yao Fu, Yipeng Zhou, Di wu, Shui Yu, Yonggang Wen, Chao Li

Then, we theoretically derive: 1) the conditions for the DP based FedAvg to converge as the number of global iterations (GI) approaches infinity; 2) the method to set the number of local iterations (LI) to minimize the negative influence of DP noises.

Federated Learning

Learning Relation Prototype from Unlabeled Texts for Long-tail Relation Extraction

1 code implementation27 Nov 2020 Yixin Cao, Jun Kuang, Ming Gao, Aoying Zhou, Yonggang Wen, Tat-Seng Chua

In this paper, we propose a general approach to learn relation prototypesfrom unlabeled texts, to facilitate the long-tail relation extraction by transferring knowledge from the relation types with sufficient trainingdata.

Relation Extraction Transfer Learning

Privacy-preserving Collaborative Learning with Automatic Transformation Search

2 code implementations CVPR 2021 Wei Gao, Shangwei Guo, Tianwei Zhang, Han Qiu, Yonggang Wen, Yang Liu

Comprehensive evaluations demonstrate that the policies discovered by our method can defeat existing reconstruction attacks in collaborative learning, with high efficiency and negligible impact on the model performance.

Data Augmentation Privacy Preserving

InferBench: Understanding Deep Learning Inference Serving with an Automatic Benchmarking System

no code implementations4 Nov 2020 Huaizheng Zhang, Yizheng Huang, Yonggang Wen, Jianxiong Yin, Kyle Guan

Our system design follows the best practice in DL clusters operations to expedite day-to-day DL service evaluation efforts by the developers.

Performance Optimization for Federated Person Re-identification via Benchmark Analysis

1 code implementation26 Aug 2020 Weiming Zhuang, Yonggang Wen, Xuesen Zhang, Xin Gan, Daiying Yin, Dongzhan Zhou, Shuai Zhang, Shuai Yi

Then we propose two optimization methods: (1) To address the unbalanced weight problem, we propose a new method to dynamically change the weights according to the scale of model changes in clients in each training round; (2) To facilitate convergence, we adopt knowledge distillation to refine the server model with knowledge generated from client models on a public dataset.

Federated Learning Knowledge Distillation +2

MLModelCI: An Automatic Cloud Platform for Efficient MLaaS

1 code implementation9 Jun 2020 Huaizheng Zhang, Yuanming Li, Yizheng Huang, Yonggang Wen, Jianxiong Yin, Kyle Guan

MLModelCI provides multimedia researchers and developers with a one-stop platform for efficient machine learning (ML) services.

Hysia: Serving DNN-Based Video-to-Retail Applications in Cloud

1 code implementation9 Jun 2020 Huaizheng Zhang, Yuanming Li, Qiming Ai, Yong Luo, Yonggang Wen, Yichao Jin, Nguyen Binh Duong Ta

Combining \underline{v}ideo streaming and online \underline{r}etailing (V2R) has been a growing trend recently.

Kalibre: Knowledge-based Neural Surrogate Model Calibration for Data Center Digital Twins

no code implementations29 Jan 2020 Ruihang Wang, Xin Zhou, Linsen Dong, Yonggang Wen, Rui Tan, Li Chen, Guan Wang, Feng Zeng

However, in the context of CFD, each search step requires long-lasting CFD model's iterated solving, rendering these approaches impractical with increased model complexity.

Look, Read and Feel: Benchmarking Ads Understanding with Multimodal Multitask Learning

no code implementations21 Dec 2019 Huaizheng Zhang, Yong Luo, Qiming Ai, Yonggang Wen

A multitask loss function is also designed to train both the topic and sentiment prediction models jointly in an end-to-end manner.

A Survey of Predictive Maintenance: Systems, Purposes and Approaches

no code implementations12 Dec 2019 Yongyi Ran, Xin Zhou, Pengfeng Lin, Yonggang Wen, Ruilong Deng

This paper provides a comprehensive literature review on Predictive Maintenance (PdM) with emphasis on system architectures, purposes and approaches.

Soft-ranking Label Encoding for Robust Facial Age Estimation

no code implementations9 Jun 2019 Xusheng Zeng, Changxing Ding, Yonggang Wen, DaCheng Tao

Moreover, we also carefully analyze existing evaluation protocols for age estimation, finding that the overlap in identity between the training and testing sets affects the relative performance of different age encoding methods.

Age Estimation

Baconian: A Unified Open-source Framework for Model-Based Reinforcement Learning

2 code implementations23 Apr 2019 Linsen Dong, Guanyu Gao, Xinyi Zhang, Liang-Yu Chen, Yonggang Wen

Model-Based Reinforcement Learning (MBRL) is one category of Reinforcement Learning (RL) algorithms which can improve sampling efficiency by modeling and approximating system dynamics.

Autonomous Driving Model-based Reinforcement Learning +1

Multi-view Vector-valued Manifold Regularization for Multi-label Image Classification

no code implementations8 Apr 2019 Yong Luo, DaCheng Tao, Chang Xu, Chao Xu, Hong Liu, Yonggang Wen

In computer vision, image datasets used for classification are naturally associated with multiple labels and comprised of multiple views, because each image may contain several objects (e. g. pedestrian, bicycle and tree) and is properly characterized by multiple visual features (e. g. color, texture and shape).

General Classification Multi-Label Image Classification

Transferring Knowledge Fragments for Learning Distance Metric from A Heterogeneous Domain

no code implementations8 Apr 2019 Yong Luo, Yonggang Wen, Tongliang Liu, DaCheng Tao

Some existing heterogeneous transfer learning (HTL) approaches can learn target distance metric by usually transforming the samples of source and target domain into a common subspace.

Metric Learning Transfer Learning

Heterogeneous Multi-task Metric Learning across Multiple Domains

no code implementations8 Apr 2019 Yong Luo, Yonggang Wen, DaCheng Tao

Heterogeneous transfer learning approaches can be adopted to remedy this drawback by deriving a metric from the learned transformation across different domains.

Metric Learning Scene Classification +2

Cost-Sensitive Feature Selection by Optimizing F-Measures

no code implementations4 Apr 2019 Meng Liu, Chang Xu, Yong Luo, Chao Xu, Yonggang Wen, DaCheng Tao

Feature selection is beneficial for improving the performance of general machine learning tasks by extracting an informative subset from the high-dimensional features.

feature selection

Optimizing Network Performance for Distributed DNN Training on GPU Clusters: ImageNet/AlexNet Training in 1.5 Minutes

1 code implementation19 Feb 2019 Peng Sun, Wansen Feng, Ruobing Han, Shengen Yan, Yonggang Wen

To address this problem, we propose a communication backend named GradientFlow for distributed DNN training, and employ a set of network optimization techniques.

Distributed, Parallel, and Cluster Computing

Energy-Efficient Thermal Comfort Control in Smart Buildings via Deep Reinforcement Learning

2 code implementations15 Jan 2019 Guanyu Gao, Jie Li, Yonggang Wen

We formulate the building thermal control as a cost-minimization problem which jointly considers the energy consumption of HVAC and the thermal comfort of the occupants.

reinforcement-learning

Transfer Metric Learning: Algorithms, Applications and Outlooks

no code implementations9 Oct 2018 Yong Luo, Yonggang Wen, Ling-Yu Duan, DaCheng Tao

Distance metric learning (DML) aims to find an appropriate way to reveal the underlying data relationship.

Metric Learning

Intelligent Trainer for Model-Based Reinforcement Learning

1 code implementation24 May 2018 Yuanlong Li, Linsen Dong, Xin Zhou, Yonggang Wen, Kyle Guan

Model-based reinforcement learning (MBRL) has been proposed as a promising alternative solution to tackle the high sampling cost challenge in the canonical reinforcement learning (RL), by leveraging a learned model to generate synthesized data for policy training purpose.

Model-based Reinforcement Learning OpenAI Gym +1

A Survey on Consensus Mechanisms and Mining Strategy Management in Blockchain Networks

no code implementations7 May 2018 Wenbo Wang, Dinh Thai Hoang, Peizhao Hu, Zehui Xiong, Dusit Niyato, Ping Wang, Yonggang Wen, Dong In Kim

This survey is motivated by the lack of a comprehensive literature review on the development of decentralized consensus mechanisms in blockchain networks.

Cryptography and Security

Transforming Cooling Optimization for Green Data Center via Deep Reinforcement Learning

no code implementations15 Sep 2017 Yuanlong Li, Yonggang Wen, Kyle Guan, DaCheng Tao

Specifically, we propose an end-to-end cooling control algorithm (CCA) that is based on the actor-critic framework and an off-policy offline version of the deep deterministic policy gradient (DDPG) algorithm.

reinforcement-learning

Power Data Classification: A Hybrid of a Novel Local Time Warping and LSTM

no code implementations15 Aug 2016 Yuanlong Li, Han Hu, Yonggang Wen, Jun Zhang

Finally, using the power consumption data from a real data center, we show that the proposed LTW can improve the classification accuracy of DTW from about 84% to 90%.

Classification General Classification +2

Tensor Canonical Correlation Analysis for Multi-view Dimension Reduction

3 code implementations9 Feb 2015 Yong Luo, DaCheng Tao, Yonggang Wen, Kotagiri Ramamohanarao, Chao Xu

As a consequence, the high order correlation information contained in the different views is explored and thus a more reliable common subspace shared by all features can be obtained.

Dimensionality Reduction MULTI-VIEW LEARNING

Cannot find the paper you are looking for? You can Submit a new open access paper.