Natural Language Processing

300 methods • 157429 papers with code

Language Models

Transformer

13045 papers with code

Focus

12886 papers with code

Diffusion

11765 papers with code

BERT

6426 papers with code

GPT-4

2655 papers with code

See all 141 methods

Transformers

Transformer

13045 papers with code

Focus

12886 papers with code

BERT

6426 papers with code

GPT-3

1839 papers with code

BART

1265 papers with code

See all 95 methods

Autoencoding Transformers

BERT

6426 papers with code

RoBERTa

888 papers with code

T5

682 papers with code

ALBERT

169 papers with code

DistilBERT

158 papers with code

See all 28 methods

Word Embeddings

GloVe

347 papers with code

fastText

235 papers with code

ELMo

233 papers with code

USE

24 papers with code

UNITER

23 papers with code

See all 21 methods

Autoregressive Transformers

Transformer

13045 papers with code

GPT-3

1839 papers with code

GPT

1096 papers with code

GPT-2

728 papers with code

XLNet

165 papers with code

See all 17 methods

Sentence Embeddings

MTS

95 papers with code

SBERT

58 papers with code

SimCSE

51 papers with code

Mirror-BERT

6 papers with code

TSDAE

3 papers with code

See all 8 methods

Attention Patterns

Strided Attention

1838 papers with code

Fixed Factorized Attention

1838 papers with code

Sliding Window Attention

99 papers with code

Global and Sliding Window Attention

84 papers with code

Dilated Sliding Window Attention

83 papers with code

See all 8 methods

Static Word Embeddings

GloVe

347 papers with code

fastText

235 papers with code

Skip-gram Word2Vec

14 papers with code

CBoW Word2Vec

6 papers with code

Mirror-BERT

6 papers with code

See all 7 methods

Contextualized Word Embeddings

ELMo

233 papers with code

USE

24 papers with code

CoVe

12 papers with code

Cross-View Training

8 papers with code

Contextualized Topic Models

7 papers with code

See all 7 methods

Text Classification Models

MixText

3 papers with code

DualCL

2 papers with code

Lbl2Vec

2 papers with code

ALDEN

1 papers with code

Lbl2TransformerVec

1 papers with code

See all 6 methods

Subword Segmentation

BPE

17462 papers with code

WordPiece

6598 papers with code

Gradient-Based Subword Tokenization

5 papers with code

Unigram Segmentation

1 papers with code

See all 4 methods

Document Embeddings

Contextualized Topic Models

7 papers with code

lda2vec

1 papers with code

EDLPS

See all 4 methods

Synthesized Attention Mechanisms

Dense Synthesized Attention

1 papers with code

Random Synthesized Attention

1 papers with code

Factorized Random Synthesized Attention

1 papers with code

Factorized Dense Synthesized Attention

1 papers with code

See all 4 methods

Language Model Pre-Training

MPNet

15 papers with code

ERNIE-GEN

1 papers with code

ReasonBERT

1 papers with code

K3M

1 papers with code

See all 4 methods

Code Generation Transformers

CodeBERT

65 papers with code

CodeT5

26 papers with code

PICARD

15 papers with code

CuBERT

2 papers with code

See all 4 methods

Table Question Answering Models

MATE

11 papers with code

TAPAS

10 papers with code

See all 4 methods

Machine Translation Models

Seq2Seq

692 papers with code

PCT

34 papers with code

See all 3 methods

Question Answering Models

Macaw

5 papers with code

TransferQA

1 papers with code

EMQAP

1 papers with code

See all 3 methods

Relation Extraction Models

Partition Filter Network

2 papers with code

HEGCN

1 papers with code

CubeRE

1 papers with code

See all 3 methods

Text Data Augmentation

DART

29 papers with code

AEDA

1 papers with code

SynthesizRR

1 papers with code

See all 3 methods

Tokenizers

WordPiece

6598 papers with code

SentencePiece

883 papers with code

See all 2 methods

Topic Embeddings

Contextualized Topic Models

7 papers with code

lda2vec

1 papers with code

See all 2 methods

Entity Recognition Models

Partition Filter Network

2 papers with code

See all 2 methods

Textual Meaning

SIRM

2 papers with code

See all 2 methods

Document Summary Evaluation

BLANC

7 papers with code

See all 2 methods

Conversational Models

SRS

38 papers with code

Meena

3 papers with code

See all 2 methods

Dialog Adaptation

DAPO

3 papers with code

See all 2 methods

Text Augmentation

MixText

3 papers with code

Augmented SBERT

1 papers with code

See all 2 methods

Inference Extrapolation

Patching

75 papers with code

ALiBi

17 papers with code

See all 2 methods

Language Model Components

Neural Cache

4 papers with code

See all 2 methods

Sequence Decoding Methods

Discriminative Adversarial Search

2 papers with code

Vulnerability-constrained Decoding

1 papers with code

See all 2 methods

Input Embedding Factorization

Adaptive Input Representations

65 papers with code

See all 1 methods

Reading Comprehension Models

Deep LSTM Reader

1 papers with code

See all 1 methods

Passage Re-Ranking Models

TILDEv2

3 papers with code

See all 1 methods

Exaggeration Detection Models

MT-PET

1 papers with code

See all 1 methods

Reading Order Detection Models

LayoutReader

1 papers with code

See all 1 methods

Span Representations

Packed Levitated Markers

2 papers with code

See all 1 methods

Taxonomy Expansion Models

TaxoExpan

1 papers with code

See all 1 methods

Open-Domain Chatbots

Meena

3 papers with code

See all 1 methods

Textual Inference Models

RAHP

2 papers with code

See all 1 methods

Dialog System Evaluation

ENIGMA

7 papers with code

See all 1 methods

Copy Mechanisms

TopK Copy

1 papers with code

See all 1 methods

Entity Retrieval Models

MuVER

1 papers with code

See all 1 methods

Paraphrase Generation Models

BTmPG

1 papers with code

See all 1 methods

Sequence Editing Models

Seq2Edits

1 papers with code

See all 1 methods

Dialogue State Trackers

FastSGT

1 papers with code

See all 1 methods

Document Understanding Models

LayoutLMv2

3 papers with code

See all 1 methods

Dependency Parsers

DDParser

1 papers with code

See all 1 methods