135 papers with code • 17 benchmarks • 9 datasets
Document Classification is a procedure of assigning one or more labels to a document from a predetermined set of labels.
We demonstrate that large gains on these tasks can be realized by generative pre-training of a language model on a diverse corpus of unlabeled text, followed by discriminative fine-tuning on each specific task.
Ranked #3 on Question Answering on Story Cloze Test
Parallel deep learning architectures like fine-tuned BERT and MT-DNN, have quickly become the state of the art, bypassing previous deep and shallow learning methods by a large margin.
We present a scalable approach for semi-supervised learning on graph-structured data that is based on an efficient variant of convolutional neural networks which operate directly on graphs.
Ranked #1 on Graph Classification on IPC-grounded
In this technical report, we adapt whole word masking in Chinese text, that masking the whole word instead of masking Chinese characters, which could bring another challenge in Masked Language Model (MLM) pre-training task.
Ranked #1 on Chinese Sentence Pair Classification on XNLI
We present graph attention networks (GATs), novel neural network architectures that operate on graph-structured data, leveraging masked self-attentional layers to address the shortcomings of prior methods based on graph convolutions or their approximations.
Ranked #2 on Node Classification on Wiki-Vote
We introduce an architecture to learn joint multilingual sentence representations for 93 languages, belonging to more than 30 different families and written in 28 different scripts.
Page classification is a crucial component to any document analysis system, allowing for complex branching control flows for different components of a given document.
Ranked #1 on Multi-Modal Document Classification on RVL-CDIP
Recent advances in cross-lingual word embeddings have primarily relied on mapping-based methods, which project pretrained word embeddings from different languages into a shared space through a linear transformation.