Multi-Task Learning
Multi-task learning aims to learn multiple different tasks simultaneously while maximizing performance on one or all of the tasks.
State-of-the-art leaderboards
| Trend | Dataset | Best Method | Paper title | Paper | Code | Compare |
|---|---|---|---|---|---|---|
|
||||||
|
||||||
|
||||||
|
||||||
|
Greatest papers with code
DRAGNN: A Transition-based Framework for Dynamically Connected Neural Networks
In this work, we present a compact, modular framework for constructing novel recurrent neural architectures.
Semi-Supervised Sequence Modeling with Cross-View Training
EMNLP 2018
• tensorflow/models
• 
We therefore propose Cross-View Training (CVT), a semi-supervised learning algorithm that improves the representations of a Bi-LSTM sentence encoder using a mix of labeled and unlabeled data.
SOTA for CCG Supertagging on CCGBank
CCG SUPERTAGGING DEPENDENCY PARSING MACHINE TRANSLATION MULTI-TASK LEARNING NAMED ENTITY RECOGNITION UNSUPERVISED REPRESENTATION LEARNING
One Model To Learn Them All
We present a single model that yields good results on a number of problems spanning multiple domains.
RetinaFace: Single-stage Dense Face Localisation in the Wild
Face Analysis Project on MXNet
SOTA for Face Detection on WIDER Face (Hard)
ERNIE 2.0: A Continual Pre-training Framework for Language Understanding
Recently, pre-trained models have achieved state-of-the-art results in various language understanding tasks, which indicates that pre-training on large-scale corpora may play a crucial role in natural language processing.
#4 best model for
Natural Language Inference
on WNLI
LINGUISTIC ACCEPTABILITY MULTI-TASK LEARNING NATURAL LANGUAGE INFERENCE QUESTION ANSWERING SEMANTIC TEXTUAL SIMILARITY SENTIMENT ANALYSIS
Learning General Purpose Distributed Sentence Representations via Large Scale Multi-task Learning
ICLR 2018
• facebookresearch/InferSent
• 
In this work, we present a simple, effective multi-task learning framework for sentence representations that combines the inductive biases of diverse training objectives in a single model.
MULTI-TASK LEARNING NATURAL LANGUAGE INFERENCE PARAPHRASE IDENTIFICATION SEMANTIC TEXTUAL SIMILARITY
Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding
• namisan/mt-dnn
•
This paper explores the use of knowledge distillation to improve a Multi-Task Deep Neural Network (MT-DNN) (Liu et al., 2019) for learning text representations across multiple natural language understanding tasks.
A Hierarchical Multi-task Approach for Learning Embeddings from Semantic Tasks
• huggingface/hmtl
•
The model is trained in a hierarchical fashion to introduce an inductive bias by supervising a set of low level tasks at the bottom layers of the model and more complex tasks at the top layers of the model.
MULTI-TASK LEARNING NAMED ENTITY RECOGNITION RELATION EXTRACTION
Agnostic Lane Detection
• cardwing/Codes-for-Lane-Detection
•
Lane detection is an important yet challenging task in autonomous driving, which is affected by many factors, e. g., light conditions, occlusions caused by other vehicles, irrelevant markings on the road and the inherent long and thin property of lanes.
#2 best model for
Lane Detection
on CULane
AUTONOMOUS DRIVING INSTANCE SEGMENTATION LANE DETECTION MULTI-TASK LEARNING SEMANTIC SEGMENTATION
OmniNet: A unified architecture for multi-modal multi-task learning
• subho406/OmniNet
•
We propose a spatio-temporal cache mechanism that enables learning spatial dimension of the input in addition to the hidden states corresponding to the temporal input sequence.
IMAGE CAPTIONING MULTI-TASK LEARNING PART-OF-SPEECH TAGGING QUESTION ANSWERING VISUAL QUESTION ANSWERING