Browse > Computer Vision > Image Generation > Image-to-Image Translation

Image-to-Image Translation

47 papers with code · Computer Vision
Subtask of Image Generation

Image-to-image translation is the task of taking images from one domain and transforming them so they have the style (or characteristics) of images from another domain.

State-of-the-art leaderboards

Greatest papers with code

Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks

ICCV 2017 tensorflow/models

Image-to-image translation is a class of vision and graphics problems where the goal is to learn the mapping between an input image and an output image using a training set of aligned image pairs. Our goal is to learn a mapping $G: X \rightarrow Y$ such that the distribution of images from $G(X)$ is indistinguishable from the distribution $Y$ using an adversarial loss.

MULTIMODAL UNSUPERVISED IMAGE-TO-IMAGE TRANSLATION STYLE TRANSFER UNSUPERVISED IMAGE-TO-IMAGE TRANSLATION

Learning from Simulated and Unsupervised Images through Adversarial Training

CVPR 2017 tensorflow/models

With recent progress in graphics, it has become more tractable to train models on synthetic images, potentially avoiding the need for expensive annotations. However, learning from synthetic images may not achieve the desired performance due to a gap between synthetic and real image distributions.

GAZE ESTIMATION HAND POSE ESTIMATION IMAGE-TO-IMAGE TRANSLATION

Image-to-Image Translation with Conditional Adversarial Networks

CVPR 2017 tensorflow/models

We investigate conditional adversarial networks as a general-purpose solution to image-to-image translation problems. These networks not only learn the mapping from input image to output image, but also learn a loss function to train this mapping.

CyCADA: Cycle-Consistent Adversarial Domain Adaptation

ICML 2018 junyanz/CycleGAN

Domain adaptation is critical for success in new, unseen environments. Adversarial adaptation models applied in feature spaces discover domain invariant representations, but are difficult to visualize and sometimes fail to capture pixel-level and low-level domain shifts.

DOMAIN ADAPTATION SEMANTIC SEGMENTATION SYNTHETIC-TO-REAL TRANSLATION UNSUPERVISED IMAGE-TO-IMAGE TRANSLATION

StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation

CVPR 2018 yunjey/StarGAN

Recent studies have shown remarkable success in image-to-image translation for two domains. To address this limitation, we propose StarGAN, a novel and scalable approach that can perform image-to-image translations for multiple domains using only a single model.

IMAGE-TO-IMAGE TRANSLATION

High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs

CVPR 2018 NVIDIA/pix2pixHD

We present a new method for synthesizing high-resolution photo-realistic images from semantic label maps using conditional generative adversarial networks (conditional GANs). Conditional GANs have enabled a variety of applications, but the results are often limited to low-resolution and still far from realistic.

CONDITIONAL IMAGE GENERATION IMAGE-TO-IMAGE TRANSLATION INSTANCE SEGMENTATION SEMANTIC SEGMENTATION

Multimodal Unsupervised Image-to-Image Translation

ECCV 2018 nvlabs/MUNIT

Given an image in the source domain, the goal is to learn the conditional distribution of corresponding images in the target domain, without seeing any pairs of corresponding images. To translate an image to another domain, we recombine its content code with a random style code sampled from the style space of the target domain.

MULTIMODAL UNSUPERVISED IMAGE-TO-IMAGE TRANSLATION UNSUPERVISED IMAGE-TO-IMAGE TRANSLATION

Unsupervised Image-to-Image Translation Networks

NeurIPS 2017 mingyuliutw/UNIT

Unsupervised image-to-image translation aims at learning a joint distribution of images in different domains by using images from the marginal distributions in individual domains. Since there exists an infinite set of joint distributions that can arrive the given marginal distributions, one could infer nothing about the joint distribution from the marginal distributions without additional assumptions.

DOMAIN ADAPTATION MULTIMODAL UNSUPERVISED IMAGE-TO-IMAGE TRANSLATION UNSUPERVISED IMAGE-TO-IMAGE TRANSLATION

Unsupervised Cross-Domain Image Generation

7 Nov 2016kaonashi-tyc/zi2zi

We study the problem of transferring a sample in one domain to an analog sample in another domain. Given two related domains, S and T, we would like to learn a generative function G that maps an input sample from S to the domain T, such that the output of a given function f, which accepts inputs in either domains, would remain unchanged.

DOMAIN ADAPTATION UNSUPERVISED IMAGE-TO-IMAGE TRANSLATION

Virtual to Real Reinforcement Learning for Autonomous Driving

13 Apr 2017SullyChen/Autopilot-TensorFlow

Given realistic frames as input, driving policy trained by reinforcement learning can nicely adapt to real world driving. To our knowledge, this is the first successful case of driving policy trained by reinforcement learning that can adapt to real world driving data.

AUTONOMOUS DRIVING DOMAIN ADAPTATION SYNTHETIC-TO-REAL TRANSLATION TRANSFER LEARNING