Search Results for author: Junwei Pan

Found 23 papers, 8 papers with code

Field-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertising

5 code implementations9 Jun 2018 Junwei Pan, Jian Xu, Alfonso Lobos Ruiz, Wenliang Zhao, Shengjun Pan, Yu Sun, Quan Lu

The data involved in CTR prediction are typically multi-field categorical data, i. e., every feature is categorical and belongs to one and only one field.

Click-Through Rate Prediction

Predicting Different Types of Conversions with Multi-Task Learning in Online Advertising

no code implementations24 Jul 2019 Junwei Pan, Yizhi Mao, Alfonso Lobos Ruiz, Yu Sun, Aaron Flores

Conversion prediction plays an important role in online advertising since Cost-Per-Action (CPA) has become one of the primary campaign performance objectives in the industry.

Multi-Task Learning

A Batched Multi-Armed Bandit Approach to News Headline Testing

no code implementations17 Aug 2019 Yizhi Mao, Miao Chen, Abhinav Wagle, Junwei Pan, Michael Natkovich, Don Matheson

At Yahoo Front Page, headline testing is carried out using a test-rollout strategy: we first allocate equal proportion of the traffic to each headline variation for a defined testing period, and then shift all future traffic to the best-performing variation.

Thompson Sampling

DeepLight: Deep Lightweight Feature Interactions for Accelerating CTR Predictions in Ad Serving

2 code implementations17 Feb 2020 Wei Deng, Junwei Pan, Tian Zhou, Deguang Kong, Aaron Flores, Guang Lin

To address the issue of significantly increased serving delay and high memory usage for ad serving in production, this paper presents \emph{DeepLight}: a framework to accelerate the CTR predictions in three aspects: 1) accelerate the model inference via explicitly searching informative feature interactions in the shallow component; 2) prune redundant layers and parameters at intra-layer and inter-layer level in the DNN component; 3) promote the sparsity of the embedding layer to preserve the most discriminant signals.

Click-Through Rate Prediction

Bid Shading in The Brave New World of First-Price Auctions

no code implementations2 Sep 2020 Djordje Gligorijevic, Tian Zhou, Bharatbhushan Shetty, Brendan Kitts, Shengjun Pan, Junwei Pan, Aaron Flores

Online auctions play a central role in online advertising, and are one of the main reasons for the industry's scalability and growth.

Bid Shading by Win-Rate Estimation and Surplus Maximization

no code implementations19 Sep 2020 Shengjun Pan, Brendan Kitts, Tian Zhou, Hao He, Bharatbhushan Shetty, Aaron Flores, Djordje Gligorijevic, Junwei Pan, Tingyu Mao, San Gultekin, Jianlong Zhang

We found that bid shading, in general, can deliver significant value to advertisers, reducing price per impression to about 55% of the unshaded cost.

Attribute

Optimizing Multiple Performance Metrics with Deep GSP Auctions for E-commerce Advertising

no code implementations5 Dec 2020 Zhilin Zhang, Xiangyu Liu, Zhenzhe Zheng, Chenrui Zhang, Miao Xu, Junwei Pan, Chuan Yu, Fan Wu, Jian Xu, Kun Gai

In e-commerce advertising, the ad platform usually relies on auction mechanisms to optimize different performance metrics, such as user experience, advertiser utility, and platform revenue.

An Efficient Deep Distribution Network for Bid Shading in First-Price Auctions

no code implementations12 Jul 2021 Tian Zhou, Hao He, Shengjun Pan, Niklas Karlsson, Bharatbhushan Shetty, Brendan Kitts, Djordje Gligorijevic, San Gultekin, Tingyu Mao, Junwei Pan, Jianlong Zhang, Aaron Flores

Since 2019, most ad exchanges and sell-side platforms (SSPs), in the online advertising industry, shifted from second to first price auctions.

Follow the Prophet: Accurate Online Conversion Rate Prediction in the Face of Delayed Feedback

1 code implementation13 Aug 2021 Haoming Li, Feiyang Pan, Xiang Ao, Zhao Yang, Min Lu, Junwei Pan, Dapeng Liu, Lei Xiao, Qing He

The delayed feedback problem is one of the imperative challenges in online advertising, which is caused by the highly diversified feedback delay of a conversion varying from a few minutes to several days.

Cross-Task Knowledge Distillation in Multi-Task Recommendation

no code implementations20 Feb 2022 Chenxiao Yang, Junwei Pan, Xiaofeng Gao, Tingyu Jiang, Dapeng Liu, Guihai Chen

Multi-task learning (MTL) has been widely used in recommender systems, wherein predicting each type of user feedback on items (e. g, click, purchase) are treated as individual tasks and jointly trained with a unified model.

Knowledge Distillation Multi-Task Learning +1

Impression Allocation and Policy Search in Display Advertising

no code implementations11 Mar 2022 Di wu, Cheng Chen, Xiujun Chen, Junwei Pan, Xun Yang, Qing Tan, Jian Xu, Kuang-Chih Lee

In order to address the unstable traffic pattern challenge and achieve the optimal overall outcome, we propose a multi-agent reinforcement learning method to adjust the bids from each guaranteed contract, which is simple, converging efficiently and scalable.

Multi-agent Reinforcement Learning

Trading Hard Negatives and True Negatives: A Debiased Contrastive Collaborative Filtering Approach

no code implementations25 Apr 2022 Chenxiao Yang, Qitian Wu, Jipeng Jin, Xiaofeng Gao, Junwei Pan, Guihai Chen

To circumvent false negatives, we develop a principled approach to improve the reliability of negative instances and prove that the objective is an unbiased estimation of sampling from the true negative distribution.

Collaborative Filtering

AutoAttention: Automatic Field Pair Selection for Attention in User Behavior Modeling

no code implementations27 Oct 2022 Zuowu Zheng, Xiaofeng Gao, Junwei Pan, Qi Luo, Guihai Chen, Dapeng Liu, Jie Jiang

In this paper, we propose a novel model named AutoAttention, which includes all item/user/context side fields as the query, and assigns a learnable weight for each field pair between behavior fields and query fields.

Click-Through Rate Prediction

AdaTask: A Task-aware Adaptive Learning Rate Approach to Multi-task Learning

no code implementations28 Nov 2022 Enneng Yang, Junwei Pan, Ximei Wang, Haibin Yu, Li Shen, Xihua Chen, Lei Xiao, Jie Jiang, Guibing Guo

In this paper, we propose to measure the task dominance degree of a parameter by the total updates of each task on this parameter.

Multi-Task Learning Recommendation Systems

ForkMerge: Mitigating Negative Transfer in Auxiliary-Task Learning

1 code implementation NeurIPS 2023 Junguang Jiang, Baixu Chen, Junwei Pan, Ximei Wang, Liu Dapeng, Jie Jiang, Mingsheng Long

Auxiliary-Task Learning (ATL) aims to improve the performance of the target task by leveraging the knowledge obtained from related tasks.

Temporal Interest Network for User Response Prediction

1 code implementation15 Aug 2023 Haolin Zhou, Junwei Pan, Xinyi Zhou, Xihua Chen, Jie Jiang, Xiaofeng Gao, Guihai Chen

To fill this gap, we propose a Temporal Interest Network (TIN) to capture the semantic-temporal correlation simultaneously between behaviors and the target.

Click-Through Rate Prediction Recommendation Systems

STEM: Unleashing the Power of Embeddings for Multi-task Recommendation

1 code implementation16 Aug 2023 Liangcai Su, Junwei Pan, Ximei Wang, Xi Xiao, Shijie Quan, Xihua Chen, Jie Jiang

Surprisingly, negative transfer still occurs in existing MTL methods on samples that receive comparable feedback across tasks.

Multi-Task Learning Recommendation Systems

Decoupled Training: Return of Frustratingly Easy Multi-Domain Learning

no code implementations19 Sep 2023 Ximei Wang, Junwei Pan, Xingzhuo Guo, Dapeng Liu, Jie Jiang

Multi-domain learning (MDL) aims to train a model with minimal average risk across multiple overlapping but non-identical domains.

Recommendation Systems

On the Embedding Collapse when Scaling up Recommendation Models

no code implementations6 Oct 2023 Xingzhuo Guo, Junwei Pan, Ximei Wang, Baixu Chen, Jie Jiang, Mingsheng Long

Recent advances in deep foundation models have led to a promising trend of developing large recommendation models to leverage vast amounts of available data.

Ad Recommendation in a Collapsed and Entangled World

no code implementations22 Feb 2024 Junwei Pan, Wei Xue, Ximei Wang, Haibin Yu, Xun Liu, Shijie Quan, Xueming Qiu, Dapeng Liu, Lei Xiao, Jie Jiang

In this paper, we present an industry ad recommendation system, paying attention to the challenges and practices of learning appropriate representations.

Feature Correlation Model Optimization

Understanding the Ranking Loss for Recommendation with Sparse User Feedback

1 code implementation21 Mar 2024 Zhutian Lin, Junwei Pan, Shangyu Zhang, Ximei Wang, Xi Xiao, Shudong Huang, Lei Xiao, Jie Jiang

In this paper, we uncover a new challenge associated with BCE loss in scenarios with sparse positive feedback, such as CTR prediction: the gradient vanishing for negative samples.

Binary Classification Click-Through Rate Prediction

Cannot find the paper you are looking for? You can Submit a new open access paper.