Search Results for author: Kai Zheng

Found 61 papers, 17 papers with code

A Unified Replay-based Continuous Learning Framework for Spatio-Temporal Prediction on Streaming Data

no code implementations23 Apr 2024 Hao Miao, Yan Zhao, Chenjuan Guo, Bin Yang, Kai Zheng, Feiteng Huang, Jiandong Xie, Christian S. Jensen

The widespread deployment of wireless and mobile devices results in a proliferation of spatio-temporal data that is used in applications, e. g., traffic prediction, human mobility mining, and air quality prediction, where spatio-temporal prediction is often essential to enable safety, predictability, or reliability.

Data Augmentation Traffic Prediction

Channel Estimation for AFDM With Superimposed Pilots

no code implementations16 Apr 2024 Kai Zheng, Miaowen Wen, Tianqi Mao, Lixia Xiao, Zhaocheng Wang

To improve the SE, we propose a novel AFDM channel estimation scheme by introducing the superimposed pilots in the DAFT domain.

UniSAR: Modeling User Transition Behaviors between Search and Recommendation

1 code implementation15 Apr 2024 Teng Shi, Zihua Si, Jun Xu, Xiao Zhang, Xiaoxue Zang, Kai Zheng, Dewei Leng, Yanan Niu, Yang song

In this paper, we propose a framework named UniSAR that effectively models the different types of fine-grained behavior transitions for providing users a Unified Search And Recommendation service.

Contrastive Learning

Poisoning Decentralized Collaborative Recommender System and Its Countermeasures

no code implementations1 Apr 2024 Ruiqi Zheng, Liang Qu, Tong Chen, Kai Zheng, Yuhui Shi, Hongzhi Yin

Knowledge sharing also opens a backdoor for model poisoning attacks, where adversaries disguise themselves as benign clients and disseminate polluted knowledge to achieve malicious goals like promoting an item's exposure rate.

Model Poisoning Recommendation Systems

Large Language Models Enhanced Collaborative Filtering

no code implementations26 Mar 2024 Zhongxiang Sun, Zihua Si, Xiaoxue Zang, Kai Zheng, Yang song, Xiao Zhang, Jun Xu

In this paper, drawing inspiration from the in-context learning and chain of thought reasoning in LLMs, we propose the Large Language Models enhanced Collaborative Filtering (LLM-CF) framework, which distils the world knowledge and reasoning capabilities of LLMs into collaborative filtering.

Collaborative Filtering In-Context Learning +2

Adaptive Hypergraph Network for Trust Prediction

1 code implementation7 Feb 2024 Rongwei Xu, Guanfeng Liu, Yan Wang, Xuyun Zhang, Kai Zheng, Xiaofang Zhou

In this paper, we propose an Adaptive Hypergraph Network for Trust Prediction (AHNTP), a novel approach that improves trust prediction accuracy by using higher-order correlations.

Contrastive Learning Decision Making

Batch-Mix Negative Sampling for Learning Recommendation Retrievers

1 code implementation CIKM 2023 Yongfu Fan, Jin Chen, Yongquan Jiang, Defu Lian, Fangda Guo, Kai Zheng

Recommendation retrievers commonly retrieve user potentially preferred items from numerous items, where the query and item representation are learned according to the dual encoders with the log-softmax loss.

Collaborative Filtering Selection bias

Generative Retrieval with Semantic Tree-Structured Item Identifiers via Contrastive Learning

no code implementations23 Sep 2023 Zihua Si, Zhongxiang Sun, Jiale Chen, Guozhang Chen, Xiaoxue Zang, Kai Zheng, Yang song, Xiao Zhang, Jun Xu

To obtain efficiency and effectiveness, this paper introduces a generative retrieval framework, namely SEATER, which learns SEmAntic Tree-structured item identifiERs via contrastive learning.

Contrastive Learning Recommendation Systems +1

To Predict or to Reject: Causal Effect Estimation with Uncertainty on Networked Data

1 code implementation15 Sep 2023 Hechuan Wen, Tong Chen, Li Kheng Chai, Shazia Sadiq, Kai Zheng, Hongzhi Yin

Due to the imbalanced nature of networked observational data, the causal effect predictions for some individuals can severely violate the positivity/overlap assumption, rendering unreliable estimations.

Graph Contrastive Learning with Generative Adversarial Network

no code implementations1 Aug 2023 Cheng Wu, Chaokun Wang, Jingcao Xu, Ziyang Liu, Kai Zheng, Xiaowei Wang, Yang song, Kun Gai

Specifically, we present GACN, a novel Generative Adversarial Contrastive learning Network for graph representation learning.

Contrastive Learning Data Augmentation +3

Graph Condensation for Inductive Node Representation Learning

no code implementations29 Jul 2023 Xinyi Gao, Tong Chen, Yilong Zang, Wentao Zhang, Quoc Viet Hung Nguyen, Kai Zheng, Hongzhi Yin

To overcome this issue, we propose mapping-aware graph condensation (MCond), explicitly learning the one-to-many node mapping from original nodes to synthetic nodes to seamlessly integrate new nodes into the synthetic graph for inductive representation learning.

Representation Learning

Personalized Elastic Embedding Learning for On-Device Recommendation

no code implementations18 Jun 2023 Ruiqi Zheng, Liang Qu, Tong Chen, Kai Zheng, Yuhui Shi, Hongzhi Yin

Given a memory budget, PEEL efficiently generates PEEs by selecting embedding blocks with the largest weights, making it adaptable to dynamic memory budgets on devices.

PANE-GNN: Unifying Positive and Negative Edges in Graph Neural Networks for Recommendation

no code implementations7 Jun 2023 Ziyang Liu, Chaokun Wang, Jingcao Xu, Cheng Wu, Kai Zheng, Yang song, Na Mou, Kun Gai

Recommender systems play a crucial role in addressing the issue of information overload by delivering personalized recommendations to users.

Denoising Graph Representation Learning +1

Instant Representation Learning for Recommendation over Large Dynamic Graphs

1 code implementation22 May 2023 Cheng Wu, Chaokun Wang, Jingcao Xu, Ziwei Fang, Tiankai Gu, Changping Wang, Yang song, Kai Zheng, Xiaowei Wang, Guorui Zhou

Furthermore, the Neighborhood Disturbance existing in dynamic graphs deteriorates the performance of neighbor-aggregation based graph models.

Recommendation Systems Representation Learning

Multi-behavior Self-supervised Learning for Recommendation

1 code implementation22 May 2023 Jingcao Xu, Chaokun Wang, Cheng Wu, Yang song, Kai Zheng, Xiaowei Wang, Changping Wang, Guorui Zhou, Kun Gai

Secondly, existing methods utilizing self-supervised learning (SSL) to tackle the data sparsity neglect the serious optimization imbalance between the SSL task and the target task.

Recommendation Systems Self-Supervised Learning

Self-Supervised Multi-Modal Sequential Recommendation

1 code implementation26 Apr 2023 Kunzhe Song, Qingfeng Sun, Can Xu, Kai Zheng, Yaming Yang

To address this issue, we propose a dual-tower retrieval architecture for sequence recommendation.

Contrastive Learning Retrieval +1

WizardLM: Empowering Large Language Models to Follow Complex Instructions

4 code implementations24 Apr 2023 Can Xu, Qingfeng Sun, Kai Zheng, Xiubo Geng, Pu Zhao, Jiazhan Feng, Chongyang Tao, Daxin Jiang

In this paper, we show an avenue for creating large amounts of instruction data with varying levels of complexity using LLM instead of humans.

Instruction Following

Model-Agnostic Decentralized Collaborative Learning for On-Device POI Recommendation

no code implementations8 Apr 2023 Jing Long, Tong Chen, Nguyen Quoc Viet Hung, Guandong Xu, Kai Zheng, Hongzhi Yin

In light of this, We propose a novel on-device POI recommendation framework, namely Model-Agnostic Collaborative learning for on-device POI recommendation (MAC), allowing users to customize their own model structures (e. g., dimension \& number of hidden layers).

Knowledge Distillation Privacy Preserving

Continuous Input Embedding Size Search For Recommender Systems

no code implementations7 Apr 2023 Yunke Qu, Tong Chen, Xiangyu Zhao, Lizhen Cui, Kai Zheng, Hongzhi Yin

Latent factor models are the most popular backbones for today's recommender systems owing to their prominent performance.

Recommendation Systems Reinforcement Learning (RL)

A Pattern Discovery Approach to Multivariate Time Series Forecasting

no code implementations20 Dec 2022 Yunyao Cheng, Chenjuan Guo, KaiXuan Chen, Kai Zhao, Bin Yang, Jiandong Xie, Christian S. Jensen, Feiteng Huang, Kai Zheng

To capture the temporal and multivariate correlations among subsequences, we design a pattern discovery model, that constructs correlations via diverse pattern functions.

Multivariate Time Series Forecasting Time Series

Trajectory Flow Map: Graph-based Approach to Analysing Temporal Evolution of Aggregated Traffic Flows in Large-scale Urban Networks

no code implementations6 Dec 2022 Jiwon Kim, Kai Zheng, Jonathan Corcoran, Sanghyung Ahn, Marty Papamanolis

First, we partition the entire network into a set of cells based on the spatial distribution of data points in individual trajectories, where the cells represent spatial regions between which aggregated traffic flows can be measured.

Graph Mining

A Comparative Study on Unsupervised Anomaly Detection for Time Series: Experiments and Analysis

no code implementations10 Sep 2022 Yan Zhao, Liwei Deng, Xuanhao Chen, Chenjuan Guo, Bin Yang, Tung Kieu, Feiteng Huang, Torben Bach Pedersen, Kai Zheng, Christian S. Jensen

The continued digitization of societal processes translates into a proliferation of time series data that cover applications such as fraud detection, intrusion detection, and energy management, where anomaly detection is often essential to enable reliability and safety.

energy management Fraud Detection +5

Uncertainty Quantification for Traffic Forecasting: A Unified Approach

no code implementations11 Aug 2022 Weizhu Qian, Dalin Zhang, Yan Zhao, Kai Zheng, James J. Q. Yu

To achieve this, we develop Deep Spatio-Temporal Uncertainty Quantification (DeepSTUQ), which can estimate both aleatoric and epistemic uncertainty.

Time Series Time Series Forecasting +2

Cache-Augmented Inbatch Importance Resampling for Training Recommender Retriever

no code implementations30 May 2022 Jin Chen, Defu Lian, Yucheng Li, Baoyun Wang, Kai Zheng, Enhong Chen

Recommender retrievers aim to rapidly retrieve a fraction of items from the entire item corpus when a user query requests, with the representative two-tower model trained with the log softmax loss.

Robust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection---Extended Version

no code implementations7 Apr 2022 Tung Kieu, Bin Yang, Chenjuan Guo, Christian S. Jensen, Yan Zhao, Feiteng Huang, Kai Zheng

This is an extended version of "Robust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection", to appear in IEEE ICDE 2022.

Outlier Detection Time Series +1

Boosting Contrastive Learning with Relation Knowledge Distillation

no code implementations8 Dec 2021 Kai Zheng, Yuanjiang Wang, Ye Yuan

We delve into this problem and find that the lightweight model is prone to collapse in semantic space when simply performing instance-wise contrast.

Contrastive Learning Knowledge Distillation +2

Unsupervised Time Series Outlier Detection with Diversity-Driven Convolutional Ensembles -- Extended Version

no code implementations22 Nov 2021 David Campos, Tung Kieu, Chenjuan Guo, Feiteng Huang, Kai Zheng, Bin Yang, Christian S. Jensen

To improve accuracy, the ensemble employs multiple basic outlier detection models built on convolutional sequence-to-sequence autoencoders that can capture temporal dependencies in time series.

Outlier Detection Time Series +1

Multimodal Dialogue Response Generation

no code implementations ACL 2022 Qingfeng Sun, Yujing Wang, Can Xu, Kai Zheng, Yaming Yang, Huang Hu, Fei Xu, Jessica Zhang, Xiubo Geng, Daxin Jiang

In such a low-resource setting, we devise a novel conversational agent, Divter, in order to isolate parameters that depend on multimodal dialogues from the entire generation model.

Dialogue Generation Response Generation +1

Fast Variational AutoEncoder with Inverted Multi-Index for Collaborative Filtering

1 code implementation13 Sep 2021 Jin Chen, Defu Lian, Binbin Jin, Xu Huang, Kai Zheng, Enhong Chen

Variational AutoEncoder (VAE) has been extended as a representative nonlinear method for collaborative filtering.

Collaborative Filtering

Contrast R-CNN for Continual Learning in Object Detection

no code implementations11 Jul 2021 Kai Zheng, Cen Chen

In our paper, we propose a new scheme for continual learning of object detection, namely Contrast R-CNN, an approach strikes a balance between retaining the old knowledge and learning the new knowledge.

Continual Learning Image Classification +4

HIFI: Anomaly Detection for Multivariate Time Series with High-order Feature Interactions

no code implementations11 Jun 2021 Liwei Deng, Xuanhao Chen, Yan Zhao, Kai Zheng

Monitoring complex systems results in massive multivariate time series data, and anomaly detection of these data is very important to maintain the normal operation of the systems.

Anomaly Detection Time Series +1

Learning to Ask Appropriate Questions in Conversational Recommendation

no code implementations11 May 2021 Xuhui Ren, Hongzhi Yin, Tong Chen, Hao Wang, Zi Huang, Kai Zheng

Hence, the ability to generate suitable clarifying questions is the key to timely tracing users' dynamic preferences and achieving successful recommendations.

Question Generation Question-Generation +1

Historical Inertia: A Neglected but Powerful Baseline for Long Sequence Time-series Forecasting

no code implementations30 Mar 2021 Yue Cui, Jiandong Xie, Kai Zheng

Long sequence time-series forecasting (LSTF) has become increasingly popular for its wide range of applications.

Time Series Time Series Forecasting

Hierarchical Hyperedge Embedding-based Representation Learning for Group Recommendation

no code implementations24 Mar 2021 Lei Guo, Hongzhi Yin, Tong Chen, Xiangliang Zhang, Kai Zheng

However, the representation learning for a group is most complex beyond the fusion of group member representation, as the personal preferences and group preferences may be in different spaces.

Representation Learning

Efficient Optimal Selection for Composited Advertising Creatives with Tree Structure

1 code implementation2 Mar 2021 Jin Chen, Tiezheng Ge, Gangwei Jiang, Zhiqiang Zhang, Defu Lian, Kai Zheng

Based on the tree structure, Thompson sampling is adapted with dynamic programming, leading to efficient exploration for potential ad creatives with the largest CTR.

Efficient Exploration Thompson Sampling

Automated Creative Optimization for E-Commerce Advertising

1 code implementation28 Feb 2021 Jin Chen, Ju Xu, Gangwei Jiang, Tiezheng Ge, Zhiqiang Zhang, Defu Lian, Kai Zheng

However, interactions between creative elements may be more complex than the inner product, and the FM-estimated CTR may be of high variance due to limited feedback.

AutoML Click-Through Rate Prediction +2

Overcoming Data Sparsity in Group Recommendation

no code implementations2 Oct 2020 Hongzhi Yin, Qinyong Wang, Kai Zheng, Zhixu Li, Xiaofang Zhou

Specifically, we first extend BGEM to model group-item interactions, and then in order to overcome the limitation and sparsity of the interaction data generated by occasional groups, we propose a self-attentive mechanism to represent groups based on the group members.

Decision Making Graph Embedding +2

SOUP: Spatial-Temporal Demand Forecasting and Competitive Supply

no code implementations24 Sep 2020 Bolong Zheng, Qi Hu, Lingfeng Ming, Jilin Hu, Lu Chen, Kai Zheng, Christian S. Jensen

In this setting, an assignment authority is to assign agents to requests such that the average idle time of the agents is minimized.

Databases Signal Processing

Stack-Sorting with Consecutive-Pattern-Avoiding Stacks

no code implementations27 Aug 2020 Colin Defant, Kai Zheng

We introduce consecutive-pattern-avoiding stack-sorting maps $\text{SC}_\sigma$, which are natural generalizations of West's stack-sorting map $s$ and natural analogues of the classical-pattern-avoiding stack-sorting maps $s_\sigma$ recently introduced by Cerbai, Claesson, and Ferrari.

Combinatorics 05A05, 05A15, 37E15

Reconstruction Regularized Deep Metric Learning for Multi-label Image Classification

no code implementations27 Jul 2020 Changsheng Li, Chong Liu, Lixin Duan, Peng Gao, Kai Zheng

In this paper, we present a novel deep metric learning method to tackle the multi-label image classification problem.

General Classification Metric Learning +1

(Locally) Differentially Private Combinatorial Semi-Bandits

no code implementations ICML 2020 Xiaoyu Chen, Kai Zheng, Zixin Zhou, Yunchang Yang, Wei Chen, Li-Wei Wang

In this paper, we study Combinatorial Semi-Bandits (CSB) that is an extension of classic Multi-Armed Bandits (MAB) under Differential Privacy (DP) and stronger Local Differential Privacy (LDP) setting.

Multi-Armed Bandits Privacy Preserving

Bilinear Graph Neural Network with Neighbor Interactions

1 code implementation10 Feb 2020 Hongmin Zhu, Fuli Feng, Xiangnan He, Xiang Wang, Yan Li, Kai Zheng, Yongdong Zhang

We term this framework as Bilinear Graph Neural Network (BGNN), which improves GNN representation ability with bilinear interactions between neighbor nodes.

General Classification Node Classification

Combinatorial Semi-Bandit in the Non-Stationary Environment

no code implementations10 Feb 2020 Wei Chen, Li-Wei Wang, Haoyu Zhao, Kai Zheng

In a special case where the reward function is linear and we have an exact oracle, we design a parameter-free algorithm that achieves nearly optimal regret both in the switching case and in the dynamic case without knowing the parameters in advance.

Equipping Experts/Bandits with Long-term Memory

no code implementations NeurIPS 2019 Kai Zheng, Haipeng Luo, Ilias Diakonikolas, Li-Wei Wang

We propose the first reduction-based approach to obtaining long-term memory guarantees for online learning in the sense of Bousquet and Warmuth, 2002, by reducing the problem to achieving typical switching regret.

Multi-Armed Bandits

Efficient Online Portfolio with Logarithmic Regret

no code implementations NeurIPS 2018 Haipeng Luo, Chen-Yu Wei, Kai Zheng

We study the decades-old problem of online portfolio management and propose the first algorithm with logarithmic regret that is not based on Cover's Universal Portfolio algorithm and admits much faster implementation.

Management

RUM: network Representation learning throUgh Multi-level structural information preservation

no code implementations8 Oct 2017 Yanlei Yu, Zhiwu Lu, Jiajun Liu, Guoping Zhao, Ji-Rong Wen, Kai Zheng

We propose a novel network representations learning model framework called RUM (network Representation learning throUgh Multi-level structural information preservation).

Representation Learning

End-to-end Learning for Short Text Expansion

no code implementations30 Aug 2017 Jian Tang, Yue Wang, Kai Zheng, Qiaozhu Mei

A novel deep memory network is proposed to automatically find relevant information from a collection of longer documents and reformulate the short text through a gating mechanism.

Recommendation Systems text-classification +1

Generalization Bounds of SGLD for Non-convex Learning: Two Theoretical Viewpoints

no code implementations19 Jul 2017 Wenlong Mou, Li-Wei Wang, Xiyu Zhai, Kai Zheng

This is the first algorithm-dependent result with reasonable dependence on aggregated step sizes for non-convex learning, and has important implications to statistical learning aspects of stochastic gradient methods in complicated models such as deep learning.

Generalization Bounds Learning Theory +1

Collect at Once, Use Effectively: Making Non-interactive Locally Private Learning Possible

no code implementations ICML 2017 Kai Zheng, Wenlong Mou, Li-Wei Wang

For learning with smooth generalized linear losses, we propose an approximate stochastic gradient oracle estimated from non-interactive LDP channel, using Chebyshev expansion.

regression

Efficient Private ERM for Smooth Objectives

no code implementations29 Mar 2017 Jiaqi Zhang, Kai Zheng, Wenlong Mou, Li-Wei Wang

For strongly convex and smooth objectives, we prove that gradient descent with output perturbation not only achieves nearly optimal utility, but also significantly improves the running time of previous state-of-the-art private optimization algorithms, for both $\epsilon$-DP and $(\epsilon, \delta)$-DP.

Cannot find the paper you are looking for? You can Submit a new open access paper.