Natural Language Processing

120 methods • 19417 papers with code

Language Models

BERT

1975 papers with code

Transformer

1751 papers with code

RoBERTa

213 papers with code

ELMo

180 papers with code

GPT-2

164 papers with code

See all 48 methods

Transformers

BERT

1975 papers with code

Transformer

1751 papers with code

RoBERTa

213 papers with code

GPT-2

164 papers with code

XLNet

88 papers with code

See all 37 methods

Autoregressive Transformers

Transformer

1751 papers with code

GPT-2

164 papers with code

XLNet

88 papers with code

GPT

58 papers with code

GPT-3

40 papers with code

See all 16 methods

Word Embeddings

GloVe

203 papers with code

ELMo

180 papers with code

fastText

134 papers with code

Skip-gram Word2Vec

10 papers with code

CoVe

6 papers with code

See all 12 methods

Autoencoding Transformers

BERT

1975 papers with code

RoBERTa

213 papers with code

ALBERT

60 papers with code

DistilBERT

33 papers with code

XLM

29 papers with code

See all 7 methods

Attention Patterns

Strided Attention

41 papers with code

Fixed Factorized Attention

41 papers with code

Sliding Window Attention

14 papers with code

Dilated Sliding Window Attention

14 papers with code

Global and Sliding Window Attention

14 papers with code

See all 6 methods

Static Word Embeddings

GloVe

203 papers with code

fastText

134 papers with code

Skip-gram Word2Vec

10 papers with code

CBoW Word2Vec

3 papers with code

lda2vec

1 papers with code

See all 6 methods

Contextualized Word Embeddings

ELMo

180 papers with code

CoVe

6 papers with code

Cross-View Training

5 papers with code

context2vec

5 papers with code

USE

5 papers with code

See all 6 methods

Synthesized Attention Mechanisms

Dense Synthesized Attention

1 papers with code

Random Synthesized Attention

1 papers with code

Factorized Random Synthesized Attention

1 papers with code

Factorized Dense Synthesized Attention

1 papers with code

See all 4 methods

Subword Segmentation

BPE

2140 papers with code

WordPiece

2019 papers with code

Unigram Segmentation

1 papers with code

See all 3 methods

Tokenizers

WordPiece

2019 papers with code

SentencePiece

142 papers with code

See all 2 methods

Machine Translation Models

Seq2Seq

344 papers with code

See all 2 methods

Document Embeddings

Contextualized Topic Models

5 papers with code

lda2vec

1 papers with code

See all 2 methods

Topic Embeddings

Contextualized Topic Models

5 papers with code

lda2vec

1 papers with code

See all 2 methods

Input Embedding Factorization

Adaptive Input Representations

32 papers with code

See all 1 methods

Reading Comprehension Models

Deep LSTM Reader

1 papers with code

See all 1 methods

Language Model Components

Neural Cache

4 papers with code

See all 1 methods