Sketch-to-Image Translation

9 papers with code • 3 benchmarks • 5 datasets

This task has no description! Would you like to contribute one?

MaskSketch: Unpaired Structure-guided Masked Image Generation

lllyasviel/controlnet CVPR 2023

We show that intermediate self-attention maps of a masked generative transformer encode important structural information of the input image, such as scene layout and object shape, and we propose a novel sampling method based on this observation to enable structure-guided generation.

27,815
10 Feb 2023

Pretraining is All You Need for Image-to-Image Translation

PITI-Synthesis/PITI 25 May 2022

We propose to use pretraining to boost general image-to-image translation.

471
25 May 2022

Image Shape Manipulation from a Single Augmented Training Sample

eliahuhorwitz/DeepSIM ICCV 2021

In this paper, we present DeepSIM, a generative model for conditional image manipulation based on a single image.

420
13 Sep 2021

Adversarial Open Domain Adaptation for Sketch-to-Photo Synthesis

Mukosame/Anime2Sketch 12 Apr 2021

In this paper, we explore open-domain sketch-to-photo translation, which aims to synthesize a realistic photo from a freehand sketch with its class label, even if the sketches of that class are missing in the training data.

1,888
12 Apr 2021

Image Shape Manipulation from a Single Augmented Training Sample

eliahuhorwitz/DeepSIM 2 Jul 2020

In this paper, we present DeepSIM, a generative model for conditional image manipulation based on a single image.

420
02 Jul 2020

SketchyCOCO: Image Generation from Freehand Scene Sketches

sysu-imsl/SketchyCOCO CVPR 2020

We introduce the first method for automatic image generation from scene-level freehand sketches.

47
05 Mar 2020

Interactive Sketch & Fill: Multiclass Sketch-to-Image Translation

arnabgho/iSketchNFill ICCV 2019

We propose an interactive GAN-based sketch-to-image translation method that helps novice users create images of simple objects.

192
24 Sep 2019

Semantic Image Synthesis with Spatially-Adaptive Normalization

NVlabs/SPADE CVPR 2019

Previous methods directly feed the semantic layout as input to the deep network, which is then processed through stacks of convolution, normalization, and nonlinearity layers.

7,531
18 Mar 2019

High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs

NVIDIA/pix2pixHD CVPR 2018

We present a new method for synthesizing high-resolution photo-realistic images from semantic label maps using conditional generative adversarial networks (conditional GANs).

6,521
30 Nov 2017