Search Results for author:
Found 2 papers, 2 papers with code
A Comparative Study of Pretrained Language Models for Long Clinical Text
Objective: Clinical knowledge enriched transformer models (e. g., ClinicalBERT) have state-of-the-art results on clinical NLP (natural language processing) tasks.
Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences
To overcome this, long sequence transformer models, e. g. Longformer and BigBird, were proposed with the idea of sparse attention mechanism to reduce the memory usage from quadratic to the sequence length to a linear scale.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
