Search Results for author: Guorui Zhou

Found 38 papers, 15 papers with code

Multifaceted User Modeling in Recommendation: A Federated Foundation Models Approach

1 code implementation22 Dec 2024 Chunxu Zhang, Guodong Long, Hongkuan Guo, Zhaojie Liu, Guorui Zhou, Zijian Zhang, Yang Liu, Bo Yang

Multifaceted user modeling aims to uncover fine-grained patterns and learn representations from user data, revealing their diverse interests and characteristics, such as profile, preference, and personality.

CRM: Retrieval Model with Controllable Condition

no code implementations18 Dec 2024 Chi Liu, Jiangxia Cao, Rui Huang, Kuo Cai, Weifeng Ding, Qiang Luo, Kun Gai, Guorui Zhou

This modification enables the retrieval stage could fulfill the target gap with ranking model, enhancing the retrieval model ability to search item candidates satisfied the user interests and condition effectively.

model Recommendation Systems +2

QARM: Quantitative Alignment Multi-Modal Recommendation at Kuaishou

no code implementations18 Nov 2024 Xinchen Luo, Jiangxia Cao, Tianyu Sun, Jinkai Yu, Rui Huang, Wei Yuan, Hezheng Lin, Yichen Zheng, Shiyao Wang, Qigen Hu, Changqing Qiu, JiaQi Zhang, Xu Zhang, Zhiheng Yan, Jingming Zhang, Simin Zhang, Mingxing Wen, Zhaojie Liu, Kun Gai, Guorui Zhou

In recent years, with the significant evolution of multi-modal large models, many recommender researchers realized the potential of multi-modal information for user interest modeling.

Multi-modal Recommendation

KuaiFormer: Transformer-Based Retrieval at Kuaishou

no code implementations15 Nov 2024 Chi Liu, Jiangxia Cao, Rui Huang, Kai Zheng, Qiang Luo, Kun Gai, Guorui Zhou

In large-scale content recommendation systems, retrieval serves as the initial stage in the pipeline, responsible for selecting thousands of candidate items from billions of options to pass on to ranking modules.

Recommendation Systems Retrieval

MARM: Unlocking the Future of Recommendation Systems through Memory Augmentation and Scalable Complexity

no code implementations14 Nov 2024 Xiao Lv, Jiangxia Cao, Shijie Guan, Xiaoyou Zhou, Zhiguang Qi, Yaqiang Zang, Ming Li, Ben Wang, Kun Gai, Guorui Zhou

Considering the above differences with LLM, we can draw a conclusion that: for a RecSys model, compared to model parameters, the computational complexity FLOPs is a more expensive factor that requires careful control.

Language Modeling Language Modelling +1

RecFlow: An Industrial Full Flow Recommendation Dataset

1 code implementation28 Oct 2024 Qi Liu, Kai Zheng, Rui Huang, Wuchao Li, Kuo Cai, Yuan Chai, Yanan Niu, Yiqun Hui, Bing Han, Na Mou, Hongning Wang, Wentian Bao, Yunen Yu, Guorui Zhou, Han Li, Yang song, Defu Lian, Kun Gai

Industrial recommendation systems (RS) rely on the multi-stage pipeline to balance effectiveness and efficiency when delivering items from a vast corpus to users.

Recommendation Systems Selection bias

A Unified Framework for Cross-Domain Recommendation

no code implementations6 Sep 2024 Jiangxia Cao, Shen Wang, Gaode Chen, Rui Huang, Shuang Yang, Zhaojie Liu, Guorui Zhou

In addressing the persistent challenges of data-sparsity and cold-start issues in domain-expert recommender systems, Cross-Domain Recommendation (CDR) emerges as a promising methodology.

Recommendation Systems Transfer Learning

DimeRec: A Unified Framework for Enhanced Sequential Recommendation via Generative Diffusion Models

no code implementations22 Aug 2024 Wuchao Li, Rui Huang, Haijun Zhao, Chi Liu, Kai Zheng, Qi Liu, Na Mou, Guorui Zhou, Defu Lian, Yang song, Wentian Bao, Enyun Yu, Wenwu Ou

Nevertheless, a straightforward combination of SR and DM leads to sub-optimal performance due to discrepancies in learning objectives (recommendation vs. noise reconstruction) and the respective learning spaces (non-stationary vs. stationary).

Image Generation Representation Learning +1

ELASTIC: Efficient Linear Attention for Sequential Interest Compression

no code implementations18 Aug 2024 Jiaxin Deng, Shiyao Wang, Song Lu, Yinfeng Li, Xinchen Luo, Yuanjun Liu, Peixing Xu, Guorui Zhou

The proposed linear dispatcher attention mechanism significantly reduces the quadratic complexity and makes the model feasible for adequately modeling extremely long sequences.

Computational Efficiency Sequential Recommendation

Moment&Cross: Next-Generation Real-Time Cross-Domain CTR Prediction for Live-Streaming Recommendation at Kuaishou

no code implementations11 Aug 2024 Jiangxia Cao, Shen Wang, Yue Li, ShengHui Wang, Jian Tang, Shiyao Wang, Shuang Yang, Zhaojie Liu, Guorui Zhou

Kuaishou, is one of the largest short-video and live-streaming platform, compared with short-video recommendations, live-streaming recommendation is more complex because of: (1) temporarily-alive to distribution, (2) user may watch for a long time with feedback delay, (3) content is unpredictable and changes over time.

Click-Through Rate Prediction

HoME: Hierarchy of Multi-Gate Experts for Multi-Task Learning at Kuaishou

no code implementations10 Aug 2024 Xu Wang, Jiangxia Cao, Zhiyi Fu, Kun Gai, Guorui Zhou

(3) Expert Underfitting: In our services, we have dozens of behavior tasks that need to be predicted, but we find that some data-sparse prediction tasks tend to ignore their specific-experts and assign large weights to shared-experts.

Multi-Task Learning

A Multimodal Transformer for Live Streaming Highlight Prediction

no code implementations15 Jun 2024 Jiaxin Deng, Shiyao Wang, Dong Shen, Liqin Zhao, Fan Yang, Guorui Zhou, Gaofeng Meng

Therefore, we propose a novel Border-aware Pairwise Loss to learn from a large-scale dataset and utilize user implicit feedback as a weak supervision signal.

Highlight Detection Prediction

MMBee: Live Streaming Gift-Sending Recommendations via Multi-Modal Fusion and Behaviour Expansion

no code implementations15 Jun 2024 Jiaxin Deng, Shiyao Wang, Yuchen Wang, Jiansong Qi, Liqin Zhao, Guorui Zhou, Gaofeng Meng

To alleviate the sparsity issue of gifting behaviors, we present a novel Graph-guided Interest Expansion (GIE) approach that learns both user and streamer representations on large-scale gifting graphs with multi-modal attributes.

Federated Adaptation for Foundation Model-based Recommendations

1 code implementation8 May 2024 Chunxu Zhang, Guodong Long, Hongkuan Guo, Xiao Fang, Yang song, Zhaojie Liu, Guorui Zhou, Zijian Zhang, Yang Liu, Bo Yang

It becomes a new open challenge to enable the foundation model to capture user preference changes in a timely manner with reasonable communication and computation costs while preserving privacy.

Federated Learning model +2

End-to-end training of Multimodal Model and ranking Model

1 code implementation9 Apr 2024 Xiuqi Deng, Lu Xu, Xiyao Li, Jinkai Yu, Erpeng Xue, Zhongyuan Wang, Di Zhang, Zhaojie Liu, Guorui Zhou, Yang song, Na Mou, Shen Jiang, Han Li

In this paper, we propose an industrial multimodal recommendation framework named EM3: End-to-end training of Multimodal Model and ranking Model, which sufficiently utilizes multimodal information and allows personalized ranking tasks to directly train the core modules in the multimodal model to obtain more task-oriented content features, without overburdening resource consumption.

Contrastive Learning model +1

Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language Model

no code implementations5 Apr 2024 Xinrun Du, Zhouliang Yu, Songyang Gao, Ding Pan, Yuyang Cheng, Ziyang Ma, Ruibin Yuan, Xingwei Qu, Jiaheng Liu, Tianyu Zheng, Xinchen Luo, Guorui Zhou, Wenhu Chen, Ge Zhang

In this study, we introduce CT-LLM, a 2B large language model (LLM) that illustrates a pivotal shift towards prioritizing the Chinese language in developing LLMs.

Language Modeling Language Modelling +1

Ensure Timeliness and Accuracy: A Novel Sliding Window Data Stream Paradigm for Live Streaming Recommendation

no code implementations22 Feb 2024 Fengqi Liang, Baigong Zheng, Liqin Zhao, Guorui Zhou, Qian Wang, Yanan Niu

In this paper, we propose a new data stream design paradigm, dubbed Sliver, that addresses the timeliness and accuracy problem of labels by reducing the window size and implementing a sliding window correspondingly.

Recommendation Systems

ContentCTR: Frame-level Live Streaming Click-Through Rate Prediction with Multimodal Transformer

no code implementations26 Jun 2023 Jiaxin Deng, Dong Shen, Shiyao Wang, Xiangyu Wu, Fan Yang, Guorui Zhou, Gaofeng Meng

However, most previous works treat the live as a whole item and explore the Click-through-Rate (CTR) prediction framework on item-level, neglecting that the dynamic changes that occur even within the same live room.

Click-Through Rate Prediction Dynamic Time Warping +1

Instant Representation Learning for Recommendation over Large Dynamic Graphs

1 code implementation22 May 2023 Cheng Wu, Chaokun Wang, Jingcao Xu, Ziwei Fang, Tiankai Gu, Changping Wang, Yang song, Kai Zheng, Xiaowei Wang, Guorui Zhou

Furthermore, the Neighborhood Disturbance existing in dynamic graphs deteriorates the performance of neighbor-aggregation based graph models.

Graph Neural Network Representation Learning

Multi-behavior Self-supervised Learning for Recommendation

1 code implementation22 May 2023 Jingcao Xu, Chaokun Wang, Cheng Wu, Yang song, Kai Zheng, Xiaowei Wang, Changping Wang, Guorui Zhou, Kun Gai

Secondly, existing methods utilizing self-supervised learning (SSL) to tackle the data sparsity neglect the serious optimization imbalance between the SSL task and the target task.

Graph Neural Network Self-Supervised Learning

An End-to-End Framework for Marketing Effectiveness Optimization under Budget Constraint

no code implementations9 Feb 2023 Ziang Yan, Shusen Wang, Guorui Zhou, Jingjian Lin, Peng Jiang

Recent advances in this field often address the budget allocation problem using a two-stage paradigm: the first stage estimates the individual-level treatment effects using causal inference algorithms, and the second stage invokes integer programming techniques to find the optimal budget allocation solution.

Causal Inference Marketing

Real Negatives Matter: Continuous Training with Real Negatives for Delayed Feedback Modeling

1 code implementation29 Apr 2021 Siyu Gu, Xiang-Rong Sheng, Ying Fan, Guorui Zhou, Xiaoqiang Zhu

If conversion happens outside the waiting window, this sample will be duplicated and ingested into the training pipeline with a positive label.

CAN: Feature Co-Action for Click-Through Rate Prediction

no code implementations11 Nov 2020 Weijie Bian, Kailun Wu, Lejian Ren, Qi Pi, Yujing Zhang, Can Xiao, Xiang-Rong Sheng, Yong-Nan Zhu, Zhangming Chan, Na Mou, Xinchen Luo, Shiming Xiang, Guorui Zhou, Xiaoqiang Zhu, Hongbo Deng

For example, a simple attempt to learn the combination of feature A and feature B <A, B> as the explicit cartesian product representation of new features can outperform previous implicit feature interaction models including factorization machine (FM)-based models and their variations.

Click-Through Rate Prediction Prediction

COLD: Towards the Next Generation of Pre-Ranking System

2 code implementations31 Jul 2020 Zhe Wang, Liqin Zhao, Biye Jiang, Guorui Zhou, Xiaoqiang Zhu, Kun Gai

We name it COLD (Computing power cost-aware Online and Lightweight Deep pre-ranking system).

Recommendation Systems

DCAF: A Dynamic Computation Allocation Framework for Online Serving System

no code implementations17 Jun 2020 Biye Jiang, Pengye Zhang, Rihan Chen, Binding Dai, Xinchen Luo, Yin Yang, Guan Wang, Guorui Zhou, Xiaoqiang Zhu, Kun Gai

These stages usually allocate resource manually with specific computing power budgets, which requires the serving configuration to adapt accordingly.

Recommendation Systems Retrieval

A Deep Recurrent Survival Model for Unbiased Ranking

1 code implementation30 Apr 2020 Jiarui Jin, Yuchen Fang, Wei-Nan Zhang, Kan Ren, Guorui Zhou, Jian Xu, Yong Yu, Jun Wang, Xiaoqiang Zhu, Kun Gai

Position bias is a critical problem in information retrieval when dealing with implicit yet biased user feedback data.

Information Retrieval model +3

Res-embedding for Deep Learning Based Click-Through Rate Prediction Modeling

no code implementations25 Jun 2019 Guorui Zhou, Kailun Wu, Weijie Bian, Zhao Yang, Xiaoqiang Zhu, Kun Gai

In this paper, we model user behavior using an interest delay model, study carefully the embedding mechanism, and obtain two important results: (i) We theoretically prove that small aggregation radius of embedding vectors of items which belongs to a same user interest domain will result in good generalization performance of deep CTR model.

Click-Through Rate Prediction

Practice on Long Sequential User Behavior Modeling for Click-Through Rate Prediction

2 code implementations22 May 2019 Qi Pi, Weijie Bian, Guorui Zhou, Xiaoqiang Zhu, Kun Gai

To our knowledge, this is one of the first industrial solutions that are capable of handling long sequential user behavior data with length scaling up to thousands.

Click-Through Rate Prediction Recommendation Systems

Lifelong Sequential Modeling with Personalized Memorization for User Response Prediction

1 code implementation2 May 2019 Kan Ren, Jiarui Qin, Yuchen Fang, Wei-Nan Zhang, Lei Zheng, Weijie Bian, Guorui Zhou, Jian Xu, Yong Yu, Xiaoqiang Zhu, Kun Gai

In order to tackle these challenges, in this paper, we propose a Hierarchical Periodic Memory Network for lifelong sequential modeling with personalized memorization of sequential patterns for each user.

Memorization

Deep Interest Evolution Network for Click-Through Rate Prediction

15 code implementations11 Sep 2018 Guorui Zhou, Na Mou, Ying Fan, Qi Pi, Weijie Bian, Chang Zhou, Xiaoqiang Zhu, Kun Gai

Easy-to-use, Modular and Extendible package of deep-learning based CTR models. DeepFM, DeepInterestNetwork(DIN), DeepInterestEvolutionNetwork(DIEN), DeepCrossNetwork(DCN), AttentionalFactorizationMachine(AFM), Neural Factorization Machine(NFM), AutoInt

Click-Through Rate Prediction Deep Learning +1

Rocket Launching: A Universal and Efficient Framework for Training Well-performing Light Net

3 code implementations14 Aug 2017 Guorui Zhou, Ying Fan, Runpeng Cui, Weijie Bian, Xiaoqiang Zhu, Kun Gai

Models applied on real time response task, like click-through rate (CTR) prediction model, require high accuracy and rigorous response time.

Click-Through Rate Prediction

Deep Interest Network for Click-Through Rate Prediction

18 code implementations21 Jun 2017 Guorui Zhou, Chengru Song, Xiaoqiang Zhu, Ying Fan, Han Zhu, Xiao Ma, Yanghui Yan, Junqi Jin, Han Li, Kun Gai

In this way, user features are compressed into a fixed-length representation vector, in regardless of what candidate ads are.

Click-Through Rate Prediction Prediction

Hierarchical Latent Semantic Mapping for Automated Topic Generation

no code implementations11 Nov 2015 Guorui Zhou, Guang Chen

Inspired by these algorithms, in this paper, we propose a novel method named Hierarchical Latent Semantic Mapping (HLSM), which automatically generates topics from corpus.

Community Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.