Browse State-of-the-Art
Datasets
Methods
More
Newsletter
RC2021
About
Trends
Portals
Libraries
Sign In
Subscribe to the PwC Newsletter
×
Stay informed on the latest trending ML papers with code, research developments, libraries, methods, and datasets.
Read previous issues
Join the community
×
You need to
log in
to edit.
You can
create a new account
if you don't have one.
Or, discuss a change on
Slack
.
Methods
> Natural Language Processing
Natural Language Processing
259 methods • 37422 papers with code
Language Models
Transformer
3504 papers with code
BERT
3428 papers with code
RoBERTa
433 papers with code
GPT-2
295 papers with code
ELMo
219 papers with code
See all 109 methods
Transformers
Transformer
3504 papers with code
BERT
3428 papers with code
RoBERTa
433 papers with code
GPT-2
295 papers with code
T5
181 papers with code
See all 86 methods
Autoencoding Transformers
BERT
3428 papers with code
RoBERTa
433 papers with code
T5
181 papers with code
ALBERT
123 papers with code
DistilBERT
71 papers with code
See all 28 methods
Word Embeddings
GloVe
264 papers with code
ELMo
219 papers with code
fastText
175 papers with code
UNITER
14 papers with code
USE
11 papers with code
See all 21 methods
Autoregressive Transformers
Transformer
3504 papers with code
GPT-2
295 papers with code
GPT-3
162 papers with code
XLNet
130 papers with code
GPT
122 papers with code
See all 17 methods
Attention Patterns
Strided Attention
163 papers with code
Fixed Factorized Attention
163 papers with code
Sliding Window Attention
34 papers with code
Dilated Sliding Window Attention
33 papers with code
Global and Sliding Window Attention
33 papers with code
See all 7 methods
Sentence Embeddings
SimCSE
18 papers with code
MTS
8 papers with code
Mirror-BERT
6 papers with code
TSDAE
3 papers with code
DeCLUTR
3 papers with code
See all 7 methods
Static Word Embeddings
GloVe
264 papers with code
fastText
175 papers with code
Skip-gram Word2Vec
11 papers with code
Mirror-BERT
6 papers with code
CBoW Word2Vec
5 papers with code
See all 7 methods
Contextualized Word Embeddings
ELMo
219 papers with code
USE
11 papers with code
Contextualized Topic Models
7 papers with code
CoVe
6 papers with code
Cross-View Training
6 papers with code
See all 7 methods
Subword Segmentation
BPE
4381 papers with code
WordPiece
3520 papers with code
Gradient-Based Subword Tokenization
3 papers with code
Unigram Segmentation
1 papers with code
See all 4 methods
Document Embeddings
Contextualized Topic Models
7 papers with code
lda2vec
1 papers with code
EDLPS
See all 4 methods
Synthesized Attention Mechanisms
Dense Synthesized Attention
1 papers with code
Random Synthesized Attention
1 papers with code
Factorized Random Synthesized Attention
1 papers with code
Factorized Dense Synthesized Attention
1 papers with code
See all 4 methods
Language Model Pre-Training
MPNet
3 papers with code
ERNIE-GEN
1 papers with code
ReasonBERT
1 papers with code
K3M
1 papers with code
See all 4 methods
Code Generation Transformers
CodeBERT
19 papers with code
CodeT5
3 papers with code
PICARD
3 papers with code
CuBERT
2 papers with code
See all 4 methods
Table Question Answering Models
TAPAS
5 papers with code
MATE
2 papers with code
See all 4 methods
Text Classification Models
MixText
1 papers with code
ALDEN
1 papers with code
DualCL
1 papers with code
See all 4 methods
Question Answering Models
Macaw
2 papers with code
TransferQA
1 papers with code
EMQAP
1 papers with code
See all 3 methods
Tokenizers
WordPiece
3520 papers with code
SentencePiece
324 papers with code
See all 2 methods
Machine Translation Models
Seq2Seq
479 papers with code
See all 2 methods
Topic Embeddings
Contextualized Topic Models
7 papers with code
lda2vec
1 papers with code
See all 2 methods
Relation Extraction Models
Partition Filter Network
2 papers with code
HEGCN
1 papers with code
See all 2 methods
Entity Recognition Models
Partition Filter Network
2 papers with code
See all 2 methods
Textual Meaning
SIRM
1 papers with code
See all 2 methods
Document Summary Evaluation
BLANC
6 papers with code
See all 2 methods
Conversational Models
SRS
4 papers with code
Meena
2 papers with code
See all 2 methods
Dialog Adaptation
DAPO
1 papers with code
See all 2 methods
Text Augmentation
MixText
1 papers with code
Augmented SBERT
1 papers with code
See all 2 methods
Language Model Components
Neural Cache
4 papers with code
See all 2 methods
Input Embedding Factorization
Adaptive Input Representations
47 papers with code
See all 1 methods
Reading Comprehension Models
Deep LSTM Reader
1 papers with code
See all 1 methods
Passage Re-Ranking Models
TILDEv2
1 papers with code
See all 1 methods
Exaggeration Detection Models
MT-PET
1 papers with code
See all 1 methods
Reading Order Detection Models
LayoutReader
1 papers with code
See all 1 methods
Span Representations
Packed Levitated Markers
2 papers with code
See all 1 methods
Taxonomy Expansion Models
TaxoExpan
1 papers with code
See all 1 methods
Open-Domain Chatbots
Meena
2 papers with code
See all 1 methods
Textual Inference Models
RAHP
1 papers with code
See all 1 methods
Dialog System Evaluation
ENIGMA
5 papers with code
See all 1 methods
Inference Extrapolation
ALiBi
1 papers with code
See all 1 methods
Copy Mechanisms
TopK Copy
1 papers with code
See all 1 methods
Entity Retrieval Models
MuVER
1 papers with code
See all 1 methods
Text Data Augmentation
AEDA
1 papers with code
See all 1 methods
Paraphrase Generation Models
BTmPG
1 papers with code
See all 1 methods
Sequence Editing Models
Seq2Edits
1 papers with code
See all 1 methods
Dialogue State Trackers
FastSGT
1 papers with code
See all 1 methods
Sequence Decoding Methods
Discriminative Adversarial Search
1 papers with code
See all 1 methods
Document Understanding Models
LayoutLMv2
1 papers with code
See all 1 methods
Dependency Parsers
DDParser
1 papers with code
See all 1 methods