Representation Learning
Representation learning is concerned with training machine learning algorithms to learn useful representations, e.g. those that are interpretable, have latent features, or can be used for transfer learning.
( Image credit: Visualizing and Understanding Convolutional Networks )
Leaderboards
| TREND | DATASET | BEST METHOD | PAPER TITLE | PAPER | CODE | COMPARE |
|---|---|---|---|---|---|---|
|
Subtasks
Greatest papers with code
Near-Optimal Representation Learning for Hierarchical Reinforcement Learning
ICLR 2019
• tensorflow/models
• 
We study the problem of representation learning in goal-conditioned hierarchical reinforcement learning.
CONTINUOUS CONTROL HIERARCHICAL REINFORCEMENT LEARNING REPRESENTATION LEARNING
Meta-Learning Update Rules for Unsupervised Representation Learning
ICLR 2019
• tensorflow/models
•
Specifically, we target semi-supervised classification performance, and we meta-learn an algorithm -- an unsupervised weight update rule -- that produces representations useful for this task.
Semi-Supervised Sequence Modeling with Cross-View Training
EMNLP 2018
• tensorflow/models
•
We therefore propose Cross-View Training (CVT), a semi-supervised learning algorithm that improves the representations of a Bi-LSTM sentence encoder using a mix of labeled and unlabeled data.
SOTA for CCG Supertagging on CCGBank
CCG SUPERTAGGING DEPENDENCY PARSING MACHINE TRANSLATION MULTI-TASK LEARNING NAMED ENTITY RECOGNITION UNSUPERVISED REPRESENTATION LEARNING
InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets
NeurIPS 2016
• tensorflow/models
•
This paper describes InfoGAN, an information-theoretic extension to the Generative Adversarial Network that is able to learn disentangled representations in a completely unsupervised manner.
#5 best model for
Unsupervised MNIST
on MNIST
IMAGE GENERATION REPRESENTATION LEARNING UNSUPERVISED IMAGE CLASSIFICATION UNSUPERVISED MNIST
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
In recent years, supervised learning with convolutional networks (CNNs) has seen huge adoption in computer vision applications.
#9 best model for
Conditional Image Generation
on CIFAR-10
CONDITIONAL IMAGE GENERATION UNSUPERVISED REPRESENTATION LEARNING
Unsupervised Cross-lingual Representation Learning at Scale
We also present a detailed empirical evaluation of the key factors that are required to achieve these gains, including the trade-offs between (1) positive transfer and capacity dilution and (2) the performance of high and low resource languages at scale.
CROSS-LINGUAL TRANSFER LANGUAGE MODELLING REPRESENTATION LEARNING
Temporal Cycle-Consistency Learning
CVPR 2019
• google-research/google-research
•
We introduce a self-supervised representation learning method based on the task of temporal alignment between videos.
TabNet: Attentive Interpretable Tabular Learning
• google-research/google-research
•
We propose a novel high-performance and interpretable canonical deep tabular data learning architecture, TabNet.
DECISION MAKING FEATURE SELECTION UNSUPERVISED REPRESENTATION LEARNING
On Mutual Information Maximization for Representation Learning
ICLR 2020
• google-research/google-research
•
Many recent methods for unsupervised or self-supervised representation learning train feature extractors by maximizing an estimate of the mutual information (MI) between different views of the data.
REPRESENTATION LEARNING SELF-SUPERVISED IMAGE CLASSIFICATION
Practical and Consistent Estimation of f-Divergences
NeurIPS 2019
• google-research/google-research
•
The estimation of an f-divergence between two probability distributions based on samples is a fundamental problem in statistics and machine learning.