Browse State-of-the-Art
Datasets
Methods
More
Newsletter
RC2022
About
Trends
Portals
Libraries
Sign In
Subscribe to the PwC Newsletter
×
Stay informed on the latest trending ML papers with code, research developments, libraries, methods, and datasets.
Read previous issues
Join the community
×
You need to
log in
to edit.
You can
create a new account
if you don't have one.
Or, discuss a change on
Slack
.
Methods
> Natural Language Processing
Natural Language Processing
288 methods • 67706 papers with code
Language Models
Transformer
5884 papers with code
BERT
4237 papers with code
GPT-3
606 papers with code
RoBERTa
591 papers with code
GPT-2
420 papers with code
See all 134 methods
Transformers
Transformer
5884 papers with code
BERT
4237 papers with code
GPT-3
606 papers with code
RoBERTa
591 papers with code
GPT-2
420 papers with code
See all 92 methods
Autoencoding Transformers
BERT
4237 papers with code
RoBERTa
591 papers with code
T5
394 papers with code
ALBERT
143 papers with code
DistilBERT
98 papers with code
See all 28 methods
Word Embeddings
GloVe
290 papers with code
ELMo
224 papers with code
fastText
194 papers with code
UNITER
20 papers with code
USE
14 papers with code
See all 21 methods
Autoregressive Transformers
Transformer
5884 papers with code
GPT-3
606 papers with code
GPT-2
420 papers with code
GPT
267 papers with code
XLNet
144 papers with code
See all 17 methods
Attention Patterns
Fixed Factorized Attention
603 papers with code
Strided Attention
602 papers with code
Sliding Window Attention
61 papers with code
Global and Sliding Window Attention
60 papers with code
Dilated Sliding Window Attention
59 papers with code
See all 8 methods
Sentence Embeddings
SBERT
31 papers with code
MTS
28 papers with code
SimCSE
27 papers with code
Mirror-BERT
6 papers with code
TSDAE
3 papers with code
See all 8 methods
Static Word Embeddings
GloVe
290 papers with code
fastText
194 papers with code
Skip-gram Word2Vec
13 papers with code
CBoW Word2Vec
6 papers with code
Mirror-BERT
6 papers with code
See all 7 methods
Contextualized Word Embeddings
ELMo
224 papers with code
USE
14 papers with code
Contextualized Topic Models
7 papers with code
CoVe
6 papers with code
Cross-View Training
6 papers with code
See all 7 methods
Text Classification Models
Lbl2Vec
2 papers with code
MixText
1 papers with code
ALDEN
1 papers with code
DualCL
1 papers with code
Lbl2TransformerVec
1 papers with code
See all 6 methods
Subword Segmentation
BPE
7558 papers with code
WordPiece
4372 papers with code
Gradient-Based Subword Tokenization
5 papers with code
Unigram Segmentation
2 papers with code
See all 4 methods
Document Embeddings
Contextualized Topic Models
7 papers with code
lda2vec
1 papers with code
EDLPS
See all 4 methods
Synthesized Attention Mechanisms
Dense Synthesized Attention
1 papers with code
Random Synthesized Attention
1 papers with code
Factorized Random Synthesized Attention
1 papers with code
Factorized Dense Synthesized Attention
1 papers with code
See all 4 methods
Language Model Pre-Training
MPNet
6 papers with code
ERNIE-GEN
1 papers with code
ReasonBERT
1 papers with code
K3M
1 papers with code
See all 4 methods
Code Generation Transformers
CodeBERT
36 papers with code
CodeT5
21 papers with code
PICARD
7 papers with code
CuBERT
2 papers with code
See all 4 methods
Table Question Answering Models
TAPAS
7 papers with code
MATE
6 papers with code
See all 4 methods
Question Answering Models
Macaw
4 papers with code
TransferQA
1 papers with code
EMQAP
1 papers with code
See all 3 methods
Relation Extraction Models
Partition Filter Network
2 papers with code
HEGCN
1 papers with code
CubeRE
1 papers with code
See all 3 methods
Tokenizers
WordPiece
4372 papers with code
SentencePiece
554 papers with code
See all 2 methods
Machine Translation Models
Seq2Seq
592 papers with code
See all 2 methods
Topic Embeddings
Contextualized Topic Models
7 papers with code
lda2vec
1 papers with code
See all 2 methods
Entity Recognition Models
Partition Filter Network
2 papers with code
See all 2 methods
Textual Meaning
SIRM
1 papers with code
See all 2 methods
Document Summary Evaluation
BLANC
6 papers with code
See all 2 methods
Conversational Models
SRS
12 papers with code
Meena
3 papers with code
See all 2 methods
Dialog Adaptation
DAPO
1 papers with code
See all 2 methods
Text Augmentation
MixText
1 papers with code
Augmented SBERT
1 papers with code
See all 2 methods
Language Model Components
Neural Cache
4 papers with code
See all 2 methods
Input Embedding Factorization
Adaptive Input Representations
55 papers with code
See all 1 methods
Reading Comprehension Models
Deep LSTM Reader
1 papers with code
See all 1 methods
Passage Re-Ranking Models
TILDEv2
2 papers with code
See all 1 methods
Exaggeration Detection Models
MT-PET
1 papers with code
See all 1 methods
Reading Order Detection Models
LayoutReader
1 papers with code
See all 1 methods
Span Representations
Packed Levitated Markers
2 papers with code
See all 1 methods
Taxonomy Expansion Models
TaxoExpan
1 papers with code
See all 1 methods
Open-Domain Chatbots
Meena
3 papers with code
See all 1 methods
Textual Inference Models
RAHP
1 papers with code
See all 1 methods
Dialog System Evaluation
ENIGMA
7 papers with code
See all 1 methods
Inference Extrapolation
ALiBi
3 papers with code
See all 1 methods
Copy Mechanisms
TopK Copy
1 papers with code
See all 1 methods
Entity Retrieval Models
MuVER
1 papers with code
See all 1 methods
Text Data Augmentation
AEDA
1 papers with code
See all 1 methods
Paraphrase Generation Models
BTmPG
1 papers with code
See all 1 methods
Sequence Editing Models
Seq2Edits
1 papers with code
See all 1 methods
Dialogue State Trackers
FastSGT
1 papers with code
See all 1 methods
Sequence Decoding Methods
Discriminative Adversarial Search
2 papers with code
See all 1 methods
Document Understanding Models
LayoutLMv2
1 papers with code
See all 1 methods
Dependency Parsers
DDParser
1 papers with code
See all 1 methods