Contextualised Word Representations

4 papers with code • 0 benchmarks • 0 datasets

This task has no description! Would you like to contribute one?

Most implemented papers

Analysing Lexical Semantic Change with Contextualised Word Representations

glnmario/cwr4lsc ACL 2020

This paper presents the first unsupervised approach to lexical semantic change that makes use of contextualised word representations.

A Tale of a Probe and a Parser

FranxYao/PoincareProbe ACL 2020

One such probe is the structural probe (Hewitt and Manning, 2019), designed to quantify the extent to which syntactic information is encoded in contextualised word representations.

MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models

cambridgeltl/mirrorwic CoNLL (EMNLP) 2021

Recent work indicated that pretrained language models (PLMs) such as BERT and RoBERTa can be transformed into effective sentence and word encoders even via simple self-supervised techniques.

Soft-prompt tuning to predict lung cancer using primary care free-text Dutch medical notes

aumc-kik/prompt_tuning_cancer_prediction 28 Mar 2023

We investigate different natural language processing (NLP) approaches based on contextualised word representations for the problem of early prediction of lung cancer using free-text patient medical notes of Dutch primary care physicians.