Search Results for author: Hongbo Deng

Found 20 papers, 5 papers with code

AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search

1 code implementation13 Jan 2020 Daoyuan Chen, Yaliang Li, Minghui Qiu, Zhen Wang, Bofang Li, Bolin Ding, Hongbo Deng, Jun Huang, Wei. Lin, Jingren Zhou

Motivated by the necessity and benefits of task-oriented BERT compression, we propose a novel compression method, AdaBERT, that leverages differentiable Neural Architecture Search to automatically compress BERT into task-adaptive small models for specific tasks.

Knowledge Distillation Neural Architecture Search

APG: Adaptive Parameter Generation Network for Click-Through Rate Prediction

1 code implementation30 Mar 2022 Bencheng Yan, Pengjie Wang, Kai Zhang, Feng Li, Hongbo Deng, Jian Xu, Bo Zheng

In many web applications, deep learning-based CTR prediction models (deep CTR models for short) are widely adopted.

Click-Through Rate Prediction

ESAM: Discriminative Domain Adaptation with Non-Displayed Items to Improve Long-Tail Performance

1 code implementation21 May 2020 Zhihong Chen, Rong Xiao, Chenliang Li, Gangfeng Ye, Haochuan Sun, Hongbo Deng

Most of ranking models are trained only with displayed items (most are hot items), but they are utilized to retrieve items in the entire space which consists of both displayed and non-displayed items (most are long-tail items).

Attribute Clustering +2

CATN: Cross-Domain Recommendation for Cold-Start Users via Aspect Transfer Network

1 code implementation21 May 2020 Cheng Zhao, Chenliang Li, Rong Xiao, Hongbo Deng, Aixin Sun

Given two relevant domains (e. g., Book and Movie), users may have interactions with items in one domain but not in the other domain.

Recommendation Systems

Towards Understanding the Overfitting Phenomenon of Deep Click-Through Rate Prediction Models

1 code implementation4 Sep 2022 Zhao-Yu Zhang, Xiang-Rong Sheng, Yujing Zhang, Biye Jiang, Shuguang Han, Hongbo Deng, Bo Zheng

However, far less attention has been paid to the overfitting problem of models in recommendation systems, which, on the contrary, is recognized as a critical issue for deep neural networks.

Click-Through Rate Prediction Recommendation Systems

Gated Group Self-Attention for Answer Selection

no code implementations26 May 2019 Dong Xu, Jianhui Ji, Haikuan Huang, Hongbo Deng, Wu-Jun Li

Nevertheless, it is difficult for RNN based models to capture the information about long-range dependency among words in the sentences of questions and answers.

Answer Selection Machine Translation +1

CAN: Feature Co-Action for Click-Through Rate Prediction

no code implementations11 Nov 2020 Weijie Bian, Kailun Wu, Lejian Ren, Qi Pi, Yujing Zhang, Can Xiao, Xiang-Rong Sheng, Yong-Nan Zhu, Zhangming Chan, Na Mou, Xinchen Luo, Shiming Xiang, Guorui Zhou, Xiaoqiang Zhu, Hongbo Deng

For example, a simple attempt to learn the combination of feature A and feature B <A, B> as the explicit cartesian product representation of new features can outperform previous implicit feature interaction models including factorization machine (FM)-based models and their variations.

Click-Through Rate Prediction

Explanation as a Defense of Recommendation

no code implementations24 Jan 2021 Aobo Yang, Nan Wang, Hongbo Deng, Hongning Wang

At training time, the two learning tasks are joined by a latent sentiment vector, which is encoded by the recommendation module and used to make word choices for explanation generation.

Explanation Generation

Learning a Product Relevance Model from Click-Through Data in E-Commerce

no code implementations14 Feb 2021 Shaowei Yao, Jiwei Tan, Xi Chen, Keping Yang, Rong Xiao, Hongbo Deng, Xiaojun Wan

We propose a novel way to consider samples of different relevance confidence, and come up with a new training objective to learn a robust relevance model with desirable score distribution.

Click-Through Rate Prediction Computational Efficiency

Path-based Deep Network for Candidate Item Matching in Recommenders

no code implementations18 May 2021 Houyi Li, Zhihong Chen, Chenliang Li, Rong Xiao, Hongbo Deng, Peng Zhang, Yongchao Liu, Haihong Tang

PDN utilizes Trigger Net to capture the user's interest in each of his/her interacted item, and Similarity Net to evaluate the similarity between each interacted item and the target item based on these items' profile and CF information.

Recommendation Systems Retrieval

Comparative Explanations of Recommendations

no code implementations1 Nov 2021 Aobo Yang, Nan Wang, Renqin Cai, Hongbo Deng, Hongning Wang

As recommendation is essentially a comparative (or ranking) process, a good explanation should illustrate to users why an item is believed to be better than another, i. e., comparative explanations about the recommended items.

Explainable Recommendation Recommendation Systems +1

Adversarial Gradient Driven Exploration for Deep Click-Through Rate Prediction

no code implementations21 Dec 2021 Kailun Wu, Zhangming Chan, Weijie Bian, Lejian Ren, Shiming Xiang, Shuguang Han, Hongbo Deng, Bo Zheng

We further show that such a process is equivalent to adding an adversarial perturbation to the model input, and thereby name our proposed approach as an the Adversarial Gradient Driven Exploration (AGE).

Click-Through Rate Prediction Recommendation Systems

GBA: A Tuning-free Approach to Switch between Synchronous and Asynchronous Training for Recommendation Model

no code implementations23 May 2022 Wenbo Su, Yuanxing Zhang, Yufeng Cai, Kaixu Ren, Pengjie Wang, Huimin Yi, Yue Song, Jing Chen, Hongbo Deng, Jian Xu, Lin Qu, Bo Zheng

High-concurrency asynchronous training upon parameter server (PS) architecture and high-performance synchronous training upon all-reduce (AR) architecture are the most commonly deployed distributed training modes for recommendation models.

Recommendation Systems

Joint Optimization of Ranking and Calibration with Contextualized Hybrid Model

no code implementations12 Aug 2022 Xiang-Rong Sheng, Jingyue Gao, Yueyao Cheng, Siran Yang, Shuguang Han, Hongbo Deng, Yuning Jiang, Jian Xu, Bo Zheng

It can be attributed to the calibration ability of the pointwise loss since the prediction can be viewed as the click probability.

Click-Through Rate Prediction

KEEP: An Industrial Pre-Training Framework for Online Recommendation via Knowledge Extraction and Plugging

no code implementations22 Aug 2022 Yujing Zhang, Zhangming Chan, Shuhao Xu, Weijie Bian, Shuguang Han, Hongbo Deng, Bo Zheng

To alleviate this issue, we propose to extract knowledge from the \textit{super-domain} that contains web-scale and long-time impression data, and further assist the online recommendation task (downstream task).

Recommendation Systems

Multi-Scenario Ranking with Adaptive Feature Learning

no code implementations29 Jun 2023 Yu Tian, Bofang Li, Si Chen, Xubin Li, Hongbo Deng, Jian Xu, Bo Zheng, Qian Wang, Chenliang Li

Recently, Multi-Scenario Learning (MSL) is widely used in recommendation and retrieval systems in the industry because it facilitates transfer learning from different scenarios, mitigating data sparsity and reducing maintenance cost.

Retrieval Transfer Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.