Search Results for author: Junjie Tang

Found 4 papers, 1 papers with code

FPTN: Fast Pure Transformer Network for Traffic Flow Forecasting

no code implementations14 Mar 2023 Junhao Zhang, Junjie Tang, Juncheng Jin, Zehui Qu

After that, to capture the complex spatio-temporal correlations simultaneously in these vectors, we utilize Transformer encoder and stack it with several layers.

Time Series Time Series Analysis

Denoising User-aware Memory Network for Recommendation

no code implementations12 Jul 2021 Zhi Bian, Shaojun Zhou, Hao Fu, Qihong Yang, Zhenqi Sun, Junjie Tang, Guiquan Liu, Kaikui Liu, Xiaolong Li

Specifically, the framework: (i) proposes a feature purification module based on orthogonal mapping, which use the representation of explicit feedback to purify the representation of implicit feedback, and effectively denoise the implicit feedback; (ii) designs a user memory network to model the long-term interests in a fine-grained way by improving the memory network, which is ignored by the existing methods; and (iii) develops a preference-aware interactive representation component to fuse the long-term and short-term interests of users based on gating to understand the evolution of unbiased preferences of users.

Denoising

LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding

no code implementations14 Dec 2020 Hao Fu, Shaojun Zhou, Qihong Yang, Junjie Tang, Guiquan Liu, Kaikui Liu, Xiaolong Li

In this work, we propose a knowledge distillation method LRC-BERT based on contrastive learning to fit the output of the intermediate layer from the angular distance aspect, which is not considered by the existing distillation methods.

Contrastive Learning Knowledge Distillation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.