Search Results for author: Mengrou Shou

Found 1 papers, 1 papers with code

Difference-Masking: Choosing What to Mask in Continued Pretraining

1 code implementation23 May 2023 Alex Wilf, Syeda Nahida Akter, Leena Mathur, Paul Pu Liang, Sheryl Mathew, Mengrou Shou, Eric Nyberg, Louis-Philippe Morency

The self-supervised objective of masking-and-predicting has led to promising performance gains on a variety of downstream tasks.

Self-Supervised Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.