Search Results for author: Guoren Wang

Found 30 papers, 16 papers with code

On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving

1 code implementation2 Mar 2024 Kaituo Feng, Changsheng Li, Dongchun Ren, Ye Yuan, Guoren Wang

However, the oversized neural networks render them impractical for deployment on resource-constrained systems, which unavoidably requires more computational time and resources during reference. To handle this, knowledge distillation offers a promising approach that compresses models by enabling a smaller student model to learn from a larger teacher model.

Autonomous Driving Knowledge Distillation +1

Rethinking Node-wise Propagation for Large-scale Graph Learning

1 code implementation9 Feb 2024 Xunkai Li, Jingyuan Ma, Zhengyu Wu, Daohan Su, Wentao Zhang, Rong-Hua Li, Guoren Wang

However, (i) Most scalable GNNs tend to treat all nodes in graphs with the same propagation rules, neglecting their topological uniqueness; (ii) Existing node-wise propagation optimization strategies are insufficient on web-scale graphs with intricate topology, where a full portrayal of nodes' local properties is required.

Graph Learning Node Classification

FedGTA: Topology-aware Averaging for Federated Graph Learning

1 code implementation22 Jan 2024 Xunkai Li, Zhengyu Wu, Wentao Zhang, Yinlin Zhu, Rong-Hua Li, Guoren Wang

Existing FGL studies fall into two categories: (i) FGL Optimization, which improves multi-client training in existing machine learning models; (ii) FGL Model, which enhances performance with complex local models and multi-client interactions.

Graph Learning

LightDiC: A Simple yet Effective Approach for Large-scale Digraph Representation Learning

1 code implementation22 Jan 2024 Xunkai Li, Meihao Liao, Zhengyu Wu, Daohan Su, Wentao Zhang, Rong-Hua Li, Guoren Wang

Most existing graph neural networks (GNNs) are limited to undirected graphs, whose restricted scope of the captured relational information hinders their expressive capabilities and deployments in real-world scenarios.

Denoising Representation Learning

Towards Effective and General Graph Unlearning via Mutual Evolution

1 code implementation22 Jan 2024 Xunkai Li, Yulin Zhao, Zhengyu Wu, Wentao Zhang, Rong-Hua Li, Guoren Wang

With the rapid advancement of AI applications, the growing needs for data privacy and model robustness have highlighted the importance of machine unlearning, especially in thriving graph-based scenarios.

Machine Unlearning

Breaking the Entanglement of Homophily and Heterophily in Semi-supervised Node Classification

no code implementations7 Dec 2023 Henan Sun, Xunkai Li, Zhengyu Wu, Daohan Su, Rong-Hua Li, Guoren Wang

Despite numerous attempts, most existing GNNs struggle to achieve optimal node representations due to the constraints of undirected graphs.

Graph Learning Node Classification

Learning to Generate Parameters of ConvNets for Unseen Image Data

no code implementations18 Oct 2023 Shiye Wang, Kaituo Feng, Changsheng Li, Ye Yuan, Guoren Wang

Typical Convolutional Neural Networks (ConvNets) depend heavily on large amounts of image data and resort to an iterative optimization algorithm (e. g., SGD or Adam) to learn network parameters, which makes training very time- and resource-intensive.

Locally Differentially Private Graph Embedding

no code implementations17 Oct 2023 Zening Li, Rong-Hua Li, Meihao Liao, Fusheng Jin, Guoren Wang

We propose LDP-GE, a novel privacy-preserving graph embedding framework, to protect the privacy of node data.

Graph Embedding Link Prediction +2

DREAM: Domain-free Reverse Engineering Attributes of Black-box Model

no code implementations20 Jul 2023 Rongqing Li, Jiaqi Yu, Changsheng Li, Wenhan Luo, Ye Yuan, Guoren Wang

There is a crucial limitation: these works assume the dataset used for training the target model to be known beforehand and leverage this dataset for model attribute attack.

Attribute

Shared Growth of Graph Neural Networks via Prompted Free-direction Knowledge Distillation

no code implementations2 Jul 2023 Kaituo Feng, Yikun Miao, Changsheng Li, Ye Yuan, Guoren Wang

Knowledge distillation (KD) has shown to be effective to boost the performance of graph neural networks (GNNs), where the typical objective is to distill knowledge from a deeper teacher GNN into a shallower student GNN.

Knowledge Distillation Transfer Learning

FedKNOW: Federated Continual Learning with Signature Task Knowledge Integration at Edge

no code implementations4 Dec 2022 Yaxin Luopan, Rui Han, Qinglong Zhang, Chi Harold Liu, Guoren Wang

Upon training for a new task, the gradient integrator ensures the prevention of catastrophic forgetting and mitigation of negative knowledge transfer by effectively combining signature tasks identified from the past local tasks and other clients' current tasks through the global model.

Continual Learning Transfer Learning

Robust Knowledge Adaptation for Dynamic Graph Neural Networks

1 code implementation22 Jul 2022 Hanjie Li, Changsheng Li, Kaituo Feng, Ye Yuan, Guoren Wang, Hongyuan Zha

By this means, we can adaptively propagate knowledge to other nodes for learning robust node embedding representations.

reinforcement-learning Reinforcement Learning (RL)

Multi-Prior Learning via Neural Architecture Search for Blind Face Restoration

1 code implementation28 Jun 2022 Yanjiang Yu, Puyang Zhang, Kaihao Zhang, Wenhan Luo, Changsheng Li, Ye Yuan, Guoren Wang

To this end, we propose a Face Restoration Searching Network (FRSNet) to adaptively search the suitable feature extraction architecture within our specified search space, which can directly contribute to the restoration quality.

Blind Face Restoration Neural Architecture Search

FreeKD: Free-direction Knowledge Distillation for Graph Neural Networks

no code implementations14 Jun 2022 Kaituo Feng, Changsheng Li, Ye Yuan, Guoren Wang

Knowledge distillation (KD) has demonstrated its effectiveness to boost the performance of graph neural networks (GNNs), where its goal is to distill knowledge from a deeper teacher GNN into a shallower student GNN.

Knowledge Distillation reinforcement-learning +2

Blind Face Restoration: Benchmark Datasets and a Baseline Model

2 code implementations8 Jun 2022 Puyang Zhang, Kaihao Zhang, Wenhan Luo, Changsheng Li, Guoren Wang

To address this problem, we first synthesize two blind face restoration benchmark datasets called EDFace-Celeb-1M (BFR128) and EDFace-Celeb-150K (BFR512).

Blind Face Restoration

Self-Supervised Information Bottleneck for Deep Multi-View Subspace Clustering

no code implementations26 Apr 2022 Shiye Wang, Changsheng Li, Yanming Li, Ye Yuan, Guoren Wang

Inheriting the advantages from information bottleneck, SIB-MSC can learn a latent space for each view to capture common information among the latent representations of different views by removing superfluous information from the view itself while retaining sufficient information for the latent representations of other views.

Clustering Multi-view Subspace Clustering

SePiCo: Semantic-Guided Pixel Contrast for Domain Adaptive Semantic Segmentation

1 code implementation19 Apr 2022 Binhui Xie, Shuang Li, Mingjia Li, Chi Harold Liu, Gao Huang, Guoren Wang

Domain adaptive semantic segmentation attempts to make satisfactory dense predictions on an unlabeled target domain by utilizing the supervised model trained on a labeled source domain.

Semantic Segmentation Synthetic-to-Real Translation

LegoDNN: Block-grained Scaling of Deep Neural Networks for Mobile Vision

no code implementations18 Dec 2021 Rui Han, Qinglong Zhang, Chi Harold Liu, Guoren Wang, Jian Tang, Lydia Y. Chen

The prior art sheds light on exploring the accuracy-resource tradeoff by scaling the model sizes in accordance to resource dynamics.

Knowledge Distillation Model Compression +1

Pareto Domain Adaptation

1 code implementation NeurIPS 2021 Fangrui Lv, Jian Liang, Kaixiong Gong, Shuang Li, Chi Harold Liu, Han Li, Di Liu, Guoren Wang

Domain adaptation (DA) attempts to transfer the knowledge from a labeled source domain to an unlabeled target domain that follows different distribution from the source.

Domain Adaptation Image Classification +2

Active Learning for Domain Adaptation: An Energy-Based Approach

1 code implementation2 Dec 2021 Binhui Xie, Longhui Yuan, Shuang Li, Chi Harold Liu, Xinjing Cheng, Guoren Wang

Unsupervised domain adaptation has recently emerged as an effective paradigm for generalizing deep neural networks to new target domains.

Active Learning Transfer Learning +1

Deep Unsupervised Active Learning on Learnable Graphs

no code implementations8 Nov 2021 Handong Ma, Changsheng Li, Xinchu Shi, Ye Yuan, Guoren Wang

To make the learnt graph structure more stable and effective, we take into account $k$-nearest neighbor graph as a priori, and learn a relation propagation graph structure.

Active Learning Graph structure learning +2

Causal Effect Estimation using Variational Information Bottleneck

1 code implementation26 Oct 2021 Zhenyu Lu, Yurong Cheng, Mingjun Zhong, George Stoian, Ye Yuan, Guoren Wang

A typical approach is to formulate causal inference as a supervised learning problem and so counterfactual could be predicted.

Causal Inference counterfactual

Semantic Distribution-aware Contrastive Adaptation for Semantic Segmentation

1 code implementation11 May 2021 Shuang Li, Binhui Xie, Bin Zang, Chi Harold Liu, Xinjing Cheng, Ruigang Yang, Guoren Wang

Specifically, we first design a pixel-wise contrastive loss by considering the correspondences between semantic distributions and pixel-wise representations from both domains.

Self-Supervised Learning Semantic Segmentation

Generalized Domain Conditioned Adaptation Network

1 code implementation23 Mar 2021 Shuang Li, Binhui Xie, Qiuxia Lin, Chi Harold Liu, Gao Huang, Guoren Wang

Domain Adaptation (DA) attempts to transfer knowledge learned in the labeled source domain to the unlabeled but related target domain without requiring large amounts of target supervision.

Attribute Domain Adaptation

On Deep Unsupervised Active Learning

no code implementations28 Jul 2020 Changsheng Li, Handong Ma, Zhao Kang, Ye Yuan, Xiao-Yu Zhang, Guoren Wang

Unsupervised active learning has attracted increasing attention in recent years, where its goal is to select representative samples in an unsupervised setting for human annotating.

Active Learning

Efficiently Indexing Large Sparse Graphs for Similarity Search

no code implementations18 Feb 2010 Guoren Wang, Bin Wang, Xiaochun Yang, IEEE Computer Society, and Ge Yu, Member, IEEE

Abstract—The graph structure is a very important means to model schemaless data with complicated structures, such as protein- protein interaction networks, chemical compounds, knowledge query inferring systems, and road networks.

Cannot find the paper you are looking for? You can Submit a new open access paper.