Search Results for author: Renhao Tan

Found 3 papers, 1 papers with code

Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Information

1 code implementation16 Jan 2024 Linfeng Ye, Shayan Mohajer Hamidi, Renhao Tan, En-hui Yang

To improve this estimate for KD, in this paper we introduce the concept of conditional mutual information (CMI) into the estimation of BCPD and propose a novel estimator called the maximum CMI (MCMI) method.

Knowledge Distillation

Conditional Mutual Information Constrained Deep Learning for Classification

no code implementations17 Sep 2023 En-hui Yang, Shayan Mohajer Hamidi, Linfeng Ye, Renhao Tan, Beverly Yang

The concepts of conditional mutual information (CMI) and normalized conditional mutual information (NCMI) are introduced to measure the concentration and separation performance of a classification deep neural network (DNN) in the output probability distribution space of the DNN, where CMI and the ratio between CMI and NCMI represent the intra-class concentration and inter-class separation of the DNN, respectively.

Classification

Dual Graph enhanced Embedding Neural Network for CTR Prediction

no code implementations1 Jun 2021 Wei Guo, Rong Su, Renhao Tan, Huifeng Guo, Yingxue Zhang, Zhirong Liu, Ruiming Tang, Xiuqiang He

To solve these problems, we propose a novel module named Dual Graph enhanced Embedding, which is compatible with various CTR prediction models to alleviate these two problems.

Click-Through Rate Prediction Recommendation Systems

Cannot find the paper you are looking for? You can Submit a new open access paper.