Search Results for author:
Found 3 papers, 3 papers with code
RecDCL: Dual Contrastive Learning for Recommendation
In this work, we investigate how to employ both batch-wise CL (BCL) and feature-wise CL (FCL) for recommendation.
GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model
Currently, the reduction in the parameter scale of large-scale pre-trained language models (PLMs) through knowledge distillation has greatly facilitated their widespread deployment on various devices.
Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method
To address these problems, we propose a general language model distillation (GLMD) method that performs two-stage word prediction distillation and vocabulary compression, which is simple and surprisingly shows extremely strong performance.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
