Search Results for author:
Found 1 papers, 0 papers with code
Better Pre-Training by Reducing Representation Confusion
Motivated by the above investigation, we propose two novel techniques to improve pre-trained language models: Decoupled Directional Relative Position (DDRP) encoding and MTH pre-training objective.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
