Browse State-of-the-Art
Datasets
Methods
More
Newsletter
RC2022
About
Trends
Portals
Libraries
Sign In
Subscribe to the PwC Newsletter
×
Stay informed on the latest trending ML papers with code, research developments, libraries, methods, and datasets.
Read previous issues
Join the community
×
You need to
log in
to edit.
You can
create a new account
if you don't have one.
Methods
> Natural Language Processing
Natural Language Processing
296 methods • 116818 papers with code
Language Models
Transformer
10021 papers with code
Diffusion
7036 papers with code
Focus
6716 papers with code
BERT
5206 papers with code
GPT-4
1697 papers with code
See all 139 methods
Transformers
Transformer
10021 papers with code
Focus
6716 papers with code
BERT
5206 papers with code
GPT-3
1446 papers with code
RoBERTa
770 papers with code
See all 94 methods
Autoencoding Transformers
BERT
5206 papers with code
RoBERTa
770 papers with code
T5
572 papers with code
ALBERT
158 papers with code
DistilBERT
129 papers with code
See all 28 methods
Word Embeddings
GloVe
321 papers with code
ELMo
228 papers with code
fastText
213 papers with code
UNITER
23 papers with code
USE
21 papers with code
See all 21 methods
Autoregressive Transformers
Transformer
10021 papers with code
GPT-3
1446 papers with code
GPT
733 papers with code
GPT-2
576 papers with code
XLNet
157 papers with code
See all 17 methods
Attention Patterns
Strided Attention
1446 papers with code
Fixed Factorized Attention
1445 papers with code
Sliding Window Attention
86 papers with code
Global and Sliding Window Attention
79 papers with code
Dilated Sliding Window Attention
78 papers with code
See all 8 methods
Sentence Embeddings
MTS
70 papers with code
SimCSE
44 papers with code
SBERT
44 papers with code
Mirror-BERT
6 papers with code
TSDAE
3 papers with code
See all 8 methods
Static Word Embeddings
GloVe
321 papers with code
fastText
213 papers with code
Skip-gram Word2Vec
14 papers with code
CBoW Word2Vec
6 papers with code
Mirror-BERT
6 papers with code
See all 7 methods
Contextualized Word Embeddings
ELMo
228 papers with code
USE
21 papers with code
CoVe
9 papers with code
Cross-View Training
8 papers with code
Contextualized Topic Models
7 papers with code
See all 7 methods
Text Classification Models
MixText
2 papers with code
DualCL
2 papers with code
Lbl2Vec
2 papers with code
ALDEN
1 papers with code
Lbl2TransformerVec
1 papers with code
See all 6 methods
Subword Segmentation
BPE
12977 papers with code
WordPiece
5360 papers with code
Gradient-Based Subword Tokenization
5 papers with code
Unigram Segmentation
1 papers with code
See all 4 methods
Document Embeddings
Contextualized Topic Models
7 papers with code
lda2vec
1 papers with code
EDLPS
See all 4 methods
Synthesized Attention Mechanisms
Dense Synthesized Attention
1 papers with code
Random Synthesized Attention
1 papers with code
Factorized Random Synthesized Attention
1 papers with code
Factorized Dense Synthesized Attention
1 papers with code
See all 4 methods
Language Model Pre-Training
MPNet
13 papers with code
ERNIE-GEN
1 papers with code
ReasonBERT
1 papers with code
K3M
1 papers with code
See all 4 methods
Code Generation Transformers
CodeBERT
51 papers with code
CodeT5
19 papers with code
PICARD
13 papers with code
CuBERT
2 papers with code
See all 4 methods
Table Question Answering Models
TAPAS
9 papers with code
MATE
7 papers with code
See all 4 methods
Machine Translation Models
Seq2Seq
658 papers with code
PCT
30 papers with code
See all 3 methods
Question Answering Models
Macaw
4 papers with code
TransferQA
1 papers with code
EMQAP
1 papers with code
See all 3 methods
Relation Extraction Models
Partition Filter Network
2 papers with code
HEGCN
1 papers with code
CubeRE
1 papers with code
See all 3 methods
Tokenizers
WordPiece
5360 papers with code
SentencePiece
759 papers with code
See all 2 methods
Topic Embeddings
Contextualized Topic Models
7 papers with code
lda2vec
1 papers with code
See all 2 methods
Entity Recognition Models
Partition Filter Network
2 papers with code
See all 2 methods
Textual Meaning
SIRM
1 papers with code
See all 2 methods
Document Summary Evaluation
BLANC
6 papers with code
See all 2 methods
Conversational Models
SRS
28 papers with code
Meena
3 papers with code
See all 2 methods
Dialog Adaptation
DAPO
1 papers with code
See all 2 methods
Text Augmentation
MixText
2 papers with code
Augmented SBERT
1 papers with code
See all 2 methods
Language Model Components
Neural Cache
4 papers with code
See all 2 methods
Sequence Decoding Methods
Discriminative Adversarial Search
2 papers with code
Vulnerability-constrained Decoding
1 papers with code
See all 2 methods
Input Embedding Factorization
Adaptive Input Representations
63 papers with code
See all 1 methods
Reading Comprehension Models
Deep LSTM Reader
1 papers with code
See all 1 methods
Passage Re-Ranking Models
TILDEv2
3 papers with code
See all 1 methods
Exaggeration Detection Models
MT-PET
1 papers with code
See all 1 methods
Reading Order Detection Models
LayoutReader
1 papers with code
See all 1 methods
Span Representations
Packed Levitated Markers
2 papers with code
See all 1 methods
Taxonomy Expansion Models
TaxoExpan
1 papers with code
See all 1 methods
Open-Domain Chatbots
Meena
3 papers with code
See all 1 methods
Textual Inference Models
RAHP
1 papers with code
See all 1 methods
Dialog System Evaluation
ENIGMA
7 papers with code
See all 1 methods
Inference Extrapolation
ALiBi
13 papers with code
See all 1 methods
Copy Mechanisms
TopK Copy
1 papers with code
See all 1 methods
Entity Retrieval Models
MuVER
1 papers with code
See all 1 methods
Text Data Augmentation
AEDA
1 papers with code
See all 1 methods
Paraphrase Generation Models
BTmPG
1 papers with code
See all 1 methods
Sequence Editing Models
Seq2Edits
1 papers with code
See all 1 methods
Dialogue State Trackers
FastSGT
1 papers with code
See all 1 methods
Document Understanding Models
LayoutLMv2
2 papers with code
See all 1 methods
Dependency Parsers
DDParser
1 papers with code
See all 1 methods