Search Results for author: Sheng Zhou

Found 61 papers, 19 papers with code

How Do Recommendation Models Amplify Popularity Bias? An Analysis from the Spectral Perspective

no code implementations18 Apr 2024 Siyi Lin, Chongming Gao, Jiawei Chen, Sheng Zhou, Binbin Hu, Can Wang

Our comprehensive theoretical and empirical investigations lead to two core insights: 1) Item popularity is memorized in the principal singular vector of the score matrix predicted by the recommendation model; 2) The dimension collapse phenomenon amplifies the impact of principal singular vector on model predictions, intensifying the popularity bias.

SIGformer: Sign-aware Graph Transformer for Recommendation

no code implementations18 Apr 2024 Sirui Chen, Jiawei Chen, Sheng Zhou, Bohao Wang, Shen Han, Chanfei Su, Yuqing Yuan, Can Wang

Integrating both positive and negative feedback to form a signed graph can lead to a more comprehensive understanding of user preferences.

Distributionally Robust Graph-based Recommendation System

1 code implementation20 Feb 2024 Bohao Wang, Jiawei Chen, Changdong Li, Sheng Zhou, Qihao Shi, Yang Gao, Yan Feng, Chun Chen, Can Wang

DR-GNN addresses two core challenges: 1) To enable DRO to cater to graph data intertwined with GNN, we reinterpret GNN as a graph smoothing regularizer, thereby facilitating the nuanced application of DRO; 2) Given the typically sparse nature of recommendation data, which might impede robust optimization, we introduce slight perturbations in the training distribution to expand its support.

Recommendation Systems

Rethinking Propagation for Unsupervised Graph Domain Adaptation

1 code implementation8 Feb 2024 Meihan Liu, Zeyu Fang, Zhen Zhang, Ming Gu, Sheng Zhou, Xin Wang, Jiajun Bu

Motivated by our empirical analysis, we reevaluate the role of GNNs in graph domain adaptation and uncover the pivotal role of the propagation process in GNNs for adapting to different graph domains.

Domain Adaptation

A Survey on Graph Condensation

no code implementations3 Feb 2024 Hongjia Xu, Liangliang Zhang, Yao Ma, Sheng Zhou, Zhuonan Zheng, Bu Jiajun

Analytics on large-scale graphs have posed significant challenges to computational efficiency and resource requirements.

Computational Efficiency

Macro Graph Neural Networks for Online Billion-Scale Recommender Systems

1 code implementation26 Jan 2024 Hao Chen, Yuanchen Bei, Qijie Shen, Yue Xu, Sheng Zhou, Wenbing Huang, Feiran Huang, Senzhang Wang, Xiao Huang

Predicting Click-Through Rate (CTR) in billion-scale recommender systems poses a long-standing challenge for Graph Neural Networks (GNNs) due to the overwhelming computational complexity involved in aggregating billions of neighbors.

Recommendation Systems

Mobility Accelerates Learning: Convergence Analysis on Hierarchical Federated Learning in Vehicular Networks

no code implementations18 Jan 2024 Tan Chen, Jintao Yan, Yuxuan Sun, Sheng Zhou, Deniz Gündüz, Zhisheng Niu

Hierarchical federated learning (HFL) enables distributed training of models across multiple devices with the help of several edge servers and a cloud edge server in a privacy-preserving manner.

Federated Learning Privacy Preserving

Exploiting Symmetric Temporally Sparse BPTT for Efficient RNN Training

no code implementations14 Dec 2023 Xi Chen, Chang Gao, Zuowen Wang, Longbiao Cheng, Sheng Zhou, Shih-Chii Liu, Tobi Delbruck

Implementing online training of RNNs on the edge calls for optimized algorithms for an efficient deployment on hardware.

Incremental Learning

Reinforcement Neighborhood Selection for Unsupervised Graph Anomaly Detection

no code implementations9 Dec 2023 Yuanchen Bei, Sheng Zhou, Qiaoyu Tan, Hao Xu, Hao Chen, Zhao Li, Jiajun Bu

To address these issues, we utilize the advantages of reinforcement learning in adaptively learning in complex environments and propose a novel method that incorporates Reinforcement neighborhood selection for unsupervised graph ANomaly Detection (RAND).

Graph Anomaly Detection Representation Learning

Exploring Sparse Spatial Relation in Graph Inference for Text-Based VQA

no code implementations13 Oct 2023 Sheng Zhou, Dan Guo, Jia Li, Xun Yang, Meng Wang

The associations between these repetitive objects are superfluous for answer reasoning; (2) two spatially distant OCR tokens detected in the image frequently have weak semantic dependencies for answer reasoning; and (3) the co-existence of nearby objects and tokens may be indicative of important visual cues for predicting answers.

Graph Learning Object +5

Modeling Spatiotemporal Periodicity and Collaborative Signal for Local-Life Service Recommendation

no code implementations22 Sep 2023 Huixuan Chi, Hao Xu, Mengya Liu, Yuanchen Bei, Sheng Zhou, Danyang Liu, Mengdi Zhang

(2) spatiotemporal collaborative signal, which indicates similar users have similar preferences at specific locations and times.

Recommendation Systems

CDR: Conservative Doubly Robust Learning for Debiased Recommendation

1 code implementation13 Aug 2023 Zijie Song, Jiawei Chen, Sheng Zhou, Qihao Shi, Yan Feng, Chun Chen, Can Wang

In recommendation systems (RS), user behavior data is observational rather than experimental, resulting in widespread bias in the data.

Imputation Recommendation Systems

Homophily-enhanced Structure Learning for Graph Clustering

1 code implementation10 Aug 2023 Ming Gu, Gaoming Yang, Sheng Zhou, Ning Ma, Jiawei Chen, Qiaoyu Tan, Meihan Liu, Jiajun Bu

Graph clustering is a fundamental task in graph analysis, and recent advances in utilizing graph neural networks (GNNs) have shown impressive results.

Clustering Graph Clustering +1

Multi-View Fusion and Distillation for Subgrade Distresses Detection based on 3D-GPR

1 code implementation9 Aug 2023 Chunpeng Zhou, Kangjie Ning, Haishuai Wang, Zhi Yu, Sheng Zhou, Jiajun Bu

To address these challenges, we introduce a novel methodology for the subgrade distress detection task by leveraging the multi-view information from 3D-GPR data.

GPR Knowledge Distillation +1

QMNet: Importance-Aware Message Exchange for Decentralized Multi-Agent Reinforcement Learning

no code implementations18 Jul 2023 Xiufeng Huang, Sheng Zhou

To improve the performance of multi-agent reinforcement learning under the constraint of wireless resources, we propose a message importance metric and design an importance-aware scheduling policy to effectively exchange messages.

Multi-agent Reinforcement Learning reinforcement-learning +1

CPDG: A Contrastive Pre-Training Method for Dynamic Graph Neural Networks

no code implementations6 Jul 2023 Yuanchen Bei, Hao Xu, Sheng Zhou, Huixuan Chi, Haishuai Wang, Mengdi Zhang, Zhao Li, Jiajun Bu

Dynamic graph data mining has gained popularity in recent years due to the rich information contained in dynamic graphs and their widespread use in the real world.

Data-Heterogeneous Hierarchical Federated Learning with Mobility

no code implementations19 Jun 2023 Tan Chen, Jintao Yan, Yuxuan Sun, Sheng Zhou, Deniz Gunduz, Zhisheng Niu

Federated learning enables distributed training of machine learning (ML) models across multiple devices in a privacy-preserving manner.

Federated Learning Privacy Preserving

OpenGSL: A Comprehensive Benchmark for Graph Structure Learning

1 code implementation NeurIPS 2023 Zhiyao Zhou, Sheng Zhou, Bochao Mao, Xuanyi Zhou, Jiawei Chen, Qiaoyu Tan, Daochen Zha, Yan Feng, Chun Chen, Can Wang

Moreover, we observe that the learned graph structure demonstrates a strong generalization ability across different GNN models, despite the high computational and space consumption.

Graph structure learning Representation Learning

MASS: Mobility-Aware Sensor Scheduling of Cooperative Perception for Connected Automated Driving

no code implementations25 Feb 2023 Yukuan Jia, Ruiqing Mao, Yuxuan Sun, Sheng Zhou, Zhisheng Niu

Specifically, we design a mobility-aware sensor scheduling (MASS) algorithm based on the restless multi-armed bandit (RMAB) theory to maximize the expected average perception gain.

Scheduling

Why is the prediction wrong? Towards underfitting case explanation via meta-classification

no code implementations20 Feb 2023 Sheng Zhou, Pierre Blanchart, Michel Crucianu, Marin Ferecatu

In this paper we present a heuristic method to provide individual explanations for those elements in a dataset (data points) which are wrongly predicted by a given classifier.

Adap-$τ$: Adaptively Modulating Embedding Magnitude for Recommendation

2 code implementations9 Feb 2023 Jiawei Chen, Junkang Wu, Jiancan Wu, Sheng Zhou, Xuezhi Cao, Xiangnan He

Recent years have witnessed the great successes of embedding-based methods in recommender systems.

Recommendation Systems

SMDP-Based Dynamic Batching for Efficient Inference on GPU-Based Platforms

no code implementations30 Jan 2023 Yaodan Xu, Jingzhou Sun, Sheng Zhou, Zhisheng Niu

In particular, parallel computing resources on the platforms, such as graphics processing units (GPUs), have higher computational and energy efficiency with larger batch sizes.

Edge-computing

Robust Sequence Networked Submodular Maximization

no code implementations28 Dec 2022 Qihao Shi, Bingyang Fu, Can Wang, Jiawei Chen, Sheng Zhou, Yan Feng, Chun Chen

The approximation ratio of the algorithm depends both on the number of the removed elements and the network topology.

Link Prediction

MOB-FL: Mobility-Aware Federated Learning for Intelligent Connected Vehicles

no code implementations7 Dec 2022 Bowen Xie, Yuxuan Sun, Sheng Zhou, Zhisheng Niu, Yang Xu, Jingran Chen, Deniz Gündüz

Federated learning (FL) is a promising approach to enable the future Internet of vehicles consisting of intelligent connected vehicles (ICVs) with powerful sensing, computing and communication capabilities.

Federated Learning Trajectory Prediction

Unbiased Knowledge Distillation for Recommendation

1 code implementation27 Nov 2022 Gang Chen, Jiawei Chen, Fuli Feng, Sheng Zhou, Xiangnan He

Traditional solutions first train a full teacher model from the training data, and then transfer its knowledge (\ie \textit{soft labels}) to supervise the learning of a compact student model.

Knowledge Distillation Model Compression +1

Hilbert Distillation for Cross-Dimensionality Networks

1 code implementation8 Nov 2022 Dian Qin, Haishuai Wang, Zhe Liu, Hongjia Xu, Sheng Zhou, Jiajun Bu

Since the distilled 2D networks are supervised by the curves converted from dimensionally heterogeneous 3D features, the 2D networks are given an informative view in terms of learning structural information embedded in well-trained high-dimensional representations.

MEET: Mobility-Enhanced Edge inTelligence for Smart and Green 6G Networks

no code implementations27 Oct 2022 Yuxuan Sun, Bowen Xie, Sheng Zhou, Zhisheng Niu

Accordingly, base stations (BSs) and edge servers (ESs) need to be densely deployed, leading to huge deployment and operation costs, in particular the energy costs.

DOLPHINS: Dataset for Collaborative Perception enabled Harmonious and Interconnected Self-driving

1 code implementation15 Jul 2022 Ruiqing Mao, Jingyu Guo, Yukuan Jia, Yuxuan Sun, Sheng Zhou, Zhisheng Niu

In this work, we release DOLPHINS: Dataset for cOllaborative Perception enabled Harmonious and INterconnected Self-driving, as a new simulated large-scale various-scenario multi-view multi-modality autonomous driving dataset, which provides a ground-breaking benchmark platform for interconnected autonomous driving.

Autonomous Driving Object Detection

A Comprehensive Survey on Deep Clustering: Taxonomy, Challenges, and Future Directions

1 code implementation15 Jun 2022 Sheng Zhou, Hongjia Xu, Zhuonan Zheng, Jiawei Chen, Zhao Li, Jiajun Bu, Jia Wu, Xin Wang, Wenwu Zhu, Martin Ester

Motivated by the tremendous success of deep learning in clustering, one of the most fundamental machine learning tasks, and the large number of recent advances in this direction, in this paper we conduct a comprehensive survey on deep clustering by proposing a new taxonomy of different state-of-the-art approaches.

Clustering Deep Clustering +1

Multi-user Co-inference with Batch Processing Capable Edge Server

no code implementations3 Jun 2022 Wenqi Shi, Sheng Zhou, Zhisheng Niu, Miao Jiang, Lu Geng

To deal with the coupled offloading and scheduling introduced by concurrent batch processing, we first consider an offline problem with a constant edge inference latency and the same latency constraint.

Scheduling

RMGN: A Regional Mask Guided Network for Parser-free Virtual Try-on

2 code implementations24 Apr 2022 Chao Lin, Zhao Li, Sheng Zhou, Shichang Hu, Jialun Zhang, Linhao Luo, Jiarun Zhang, Longtao Huang, Yuan He

Virtual try-on(VTON) aims at fitting target clothes to reference person images, which is widely adopted in e-commerce. Existing VTON approaches can be narrowly categorized into Parser-Based(PB) and Parser-Free(PF) by whether relying on the parser information to mask the persons' clothes and synthesize try-on images.

Virtual Try-on

Time-Correlated Sparsification for Efficient Over-the-Air Model Aggregation in Wireless Federated Learning

no code implementations17 Feb 2022 Yuxuan Sun, Sheng Zhou, Zhisheng Niu, Deniz Gündüz

In this work, we propose time-correlated sparsification with hybrid aggregation (TCS-H) for communication-efficient FEEL, which exploits jointly the power of model compression and over-the-air computation.

Federated Learning Model Compression +1

Online V2X Scheduling for Raw-Level Cooperative Perception

no code implementations12 Feb 2022 Yukuan Jia, Ruiqing Mao, Yuxuan Sun, Sheng Zhou, Zhisheng Niu

Cooperative perception of connected vehicles comes to the rescue when the field of view restricts stand-alone intelligence.

Scheduling

Online Adversarial Distillation for Graph Neural Networks

no code implementations28 Dec 2021 Can Wang, Zhe Wang, Defang Chen, Sheng Zhou, Yan Feng, Chun Chen

However, its effect on graph neural networks is less than satisfactory since the graph topology and node attributes are likely to change in a dynamic way and in this case a static teacher model is insufficient in guiding student training.

Knowledge Distillation

Coded Computation across Shared Heterogeneous Workers with Communication Delay

no code implementations23 Sep 2021 Yuxuan Sun, Fan Zhang, Junlin Zhao, Sheng Zhou, Zhisheng Niu, Deniz Gündüz

In this work, we consider a multi-master heterogeneous-worker distributed computing scenario, where multiple matrix multiplication tasks are encoded and allocated to workers for parallel computation.

Distributed Computing

Popularity Bias Is Not Always Evil: Disentangling Benign and Harmful Bias for Recommendation

no code implementations16 Sep 2021 Zihao Zhao, Jiawei Chen, Sheng Zhou, Xiangnan He, Xuezhi Cao, Fuzheng Zhang, Wei Wu

To sufficiently exploit such important information for recommendation, it is essential to disentangle the benign popularity bias caused by item quality from the harmful popularity bias caused by conformity.

Recommendation Systems

Efficient Medical Image Segmentation Based on Knowledge Distillation

1 code implementation23 Aug 2021 Dian Qin, Jiajun Bu, Zhe Liu, Xin Shen, Sheng Zhou, Jingjun Gu, Zhijua Wang, Lei Wu, Huifen Dai

To deal with this problem, we propose an efficient architecture by distilling knowledge from well-trained medical image segmentation networks to train another lightweight network.

Image Segmentation Knowledge Distillation +3

Distilling Holistic Knowledge with Graph Neural Networks

1 code implementation ICCV 2021 Sheng Zhou, Yucheng Wang, Defang Chen, Jiawei Chen, Xin Wang, Can Wang, Jiajun Bu

The holistic knowledge is represented as a unified graph-based embedding by aggregating individual knowledge from relational neighborhood samples with graph neural networks, the student network is learned by distilling the holistic knowledge in a contrastive manner.

Knowledge Distillation

Uncertainty-Guided Mixup for Semi-Supervised Domain Adaptation without Source Data

no code implementations14 Jul 2021 Ning Ma, Jiajun Bu, Zhen Zhang, Sheng Zhou

Present domain adaptation methods usually perform explicit representation alignment by simultaneously accessing the source data and target data.

Privacy Preserving Semi-supervised Domain Adaptation +1

Semi-Supervised Hypothesis Transfer for Source-Free Domain Adaptation

no code implementations14 Jul 2021 Ning Ma, Jiajun Bu, Lixian Lu, Jun Wen, Zhen Zhang, Sheng Zhou, Xifeng Yan

Domain Adaptation has been widely used to deal with the distribution shift in vision, language, multimedia etc.

Source-Free Domain Adaptation

Dynamic Scheduling for Over-the-Air Federated Edge Learning with Energy Constraints

no code implementations31 May 2021 Yuxuan Sun, Sheng Zhou, Zhisheng Niu, Deniz Gündüz

In this work, we consider an over-the-air FEEL system with analog gradient aggregation, and propose an energy-aware dynamic device scheduling algorithm to optimize the training performance under energy constraints of devices, where both communication energy for gradient aggregation and computation energy for local training are included.

Scheduling

SamWalker++: recommendation with informative sampling strategy

1 code implementation16 Nov 2020 Can Wang, Jiawei Chen, Sheng Zhou, Qihao Shi, Yan Feng, Chun Chen

However, the social network information may not be available in many recommender systems, which hinders application of SamWalker.

Recommendation Systems

CoSam: An Efficient Collaborative Adaptive Sampler for Recommendation

no code implementations16 Nov 2020 Jiawei Chen, Chengquan Jiang, Can Wang, Sheng Zhou, Yan Feng, Chun Chen, Martin Ester, Xiangnan He

To deal with these problems, we propose an efficient and effective collaborative sampling method CoSam, which consists of: (1) a collaborative sampler model that explicitly leverages user-item interaction information in sampling probability and exhibits good properties of normalization, adaption, interaction information awareness, and sampling efficiency; and (2) an integrated sampler-recommender framework, leveraging the sampler model in prediction to offset the bias caused by uneven sampling.

Recommendation Systems

Cluster-Based Cooperative Digital Over-the-Air Aggregation for Wireless Federated Edge Learning

no code implementations3 Aug 2020 Ruichen Jiang, Sheng Zhou

To mitigate wireless fading, we further propose a cluster-based system and design the relay selection scheme based on the normalized detection SNR.

Federated Learning Quantization

Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning

no code implementations14 Jul 2020 Wenqi Shi, Sheng Zhou, Zhisheng Niu, Miao Jiang, Lu Geng

Then, a greedy device scheduling algorithm is introduced, which in each step selects the device consuming the least updating time obtained by the optimal bandwidth allocation, until the lower bound begins to increase, meaning that scheduling more devices will degrade the model accuracy.

Federated Learning Scheduling

Dynamic Compression Ratio Selection for Edge Inference Systems with Hard Deadlines

no code implementations25 May 2020 Xiufeng Huang, Sheng Zhou

To reduce the communication cost, lossy data compression can be exploited for inference tasks, but may bring more erroneous inference results.

Autonomous Driving BIG-bench Machine Learning +1

Fast Adaptively Weighted Matrix Factorization for Recommendation with Implicit Feedback

no code implementations4 Mar 2020 Jiawei Chen, Can Wang, Sheng Zhou, Qihao Shi, Jingbang Chen, Yan Feng, Chun Chen

A popular and effective approach for implicit recommendation is to treat unobserved data as negative but downweight their confidence.

How Does BN Increase Collapsed Neural Network Filters?

no code implementations30 Jan 2020 Sheng Zhou, Xinjiang Wang, Ping Luo, Litong Feng, Wenjie Li, Wei zhang

This phenomenon is caused by the normalization effect of BN, which induces a non-trainable region in the parameter space and reduces the network capacity as a result.

object-detection Object Detection

Device Scheduling with Fast Convergence for Wireless Federated Learning

no code implementations3 Nov 2019 Wenqi Shi, Sheng Zhou, Zhisheng Niu

In each iteration of FL (called round), the edge devices update local models based on their own data and contribute to the global training by uploading the model updates via wireless channels.

Federated Learning Scheduling

Energy-Aware Analog Aggregation for Federated Learning with Redundant Data

no code implementations1 Nov 2019 Yuxuan Sun, Sheng Zhou, Deniz Gündüz

In this work, we consider analog aggregation to scale down the communication cost with respect to the number of workers, and introduce data redundancy to the system to deal with non-i. i. d.

Federated Learning Scheduling

Improving Device-Edge Cooperative Inference of Deep Learning via 2-Step Pruning

1 code implementation8 Mar 2019 Wenqi Shi, Yunzhong Hou, Sheng Zhou, Zhisheng Niu, Yang Zhang, Lu Geng

Since the output data size of a DNN layer can be larger than that of the raw data, offloading intermediate data between layers can suffer from high transmission latency under limited wireless bandwidth.

Distributed Policy Learning Based Random Access for Diversified QoS Requirements

no code implementations6 Mar 2019 Zhiyuan Jiang, Sheng Zhou, Zhisheng Niu

Future wireless access networks need to support diversified quality of service (QoS) metrics required by various types of Internet-of-Things (IoT) devices, e. g., age of information (AoI) for status generating sources and ultra low latency for safety information in vehicular networks.

HAHE: Hierarchical Attentive Heterogeneous Information Network Embedding

2 code implementations31 Jan 2019 Sheng Zhou, Jiajun Bu, Xin Wang, Jia-Wei Chen, Can Wang

Second, given a meta path, nodes in HIN are connected by path instances while existing works fail to fully explore the differences between path instances that reflect nodes' preferences in the semantic space.

Network Embedding

A Two-Step Learning and Interpolation Method for Location-Based Channel Database

no code implementations4 Dec 2018 Ruichen Deng, Zhiyuan Jiang, Sheng Zhou, Shuguang Cui, Zhisheng Niu

Timely and accurate knowledge of channel state information (CSI) is necessary to support scheduling operations at both physical and network layers.

Scheduling

Time-Sequence Channel Inference for Beam Alignment in Vehicular Networks

no code implementations4 Dec 2018 Sheng Chen, Zhiyuan Jiang, Sheng Zhou, Zhisheng Niu

In this paper, we propose a learning-based low-overhead beam alignment method for vehicle-to-infrastructure communication in vehicular networks.

Neural Network simulation

Exploiting Wireless Channel State Information Structures Beyond Linear Correlations: A Deep Learning Approach

no code implementations3 Dec 2018 Zhiyuan Jiang, Sheng Chen, Andreas F. Molisch, Rath Vannithamby, Sheng Zhou, Zhisheng Niu

Knowledge of information about the propagation channel in which a wireless system operates enables better, more efficient approaches for signal transmissions.

Dimensionality Reduction

A Block Regression Model for Short-Term Mobile Traffic Forecasting

no code implementations17 Nov 2015 Huimin Pan, Jingchu Liu, Sheng Zhou, Zhisheng Niu

Based on these characteristics, we propose a \emph{Block Regression} ({BR}) model for mobile traffic forecasting.

regression

Cannot find the paper you are looking for? You can Submit a new open access paper.