Search Results for author:
Found 2 papers, 0 papers with code
Do not Mask Randomly: Effective Domain-adaptive Pre-training by Masking In-domain Keywords
We propose a novel task-agnostic in-domain pre-training method that sits between generic pre-training and fine-tuning.
A Compact Pretraining Approach for Neural Language Models
We construct these compact subsets from the unstructured data using a combination of abstractive summaries and extractive keywords.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
