XingGAN for Person Image Generation

ECCV 2020  ยท  Hao Tang, Song Bai, Li Zhang, Philip H. S. Torr, Nicu Sebe ยท

We propose a novel Generative Adversarial Network (XingGAN or CrossingGAN) for person image generation tasks, i.e., translating the pose of a given person to a desired one. The proposed Xing generator consists of two generation branches that model the person's appearance and shape information, respectively. Moreover, we propose two novel blocks to effectively transfer and update the person's shape and appearance embeddings in a crossing way to mutually improve each other, which has not been considered by any other existing GAN-based image generation work. Extensive experiments on two challenging datasets, i.e., Market-1501 and DeepFashion, demonstrate that the proposed XingGAN advances the state-of-the-art performance both in terms of objective quantitative scores and subjective visual realness. The source code and trained models are available at https://github.com/Ha0Tang/XingGAN.

PDF Abstract ECCV 2020 PDF ECCV 2020 Abstract

Results from the Paper


 Ranked #1 on Pose Transfer on Market-1501 (IS metric)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Pose Transfer Deep-Fashion XingGAN SSIM 0.778 # 2
IS 3.476 # 1
PCKh 0.95 # 3
Pose Transfer Market-1501 XingGAN IS 3.506 # 1
PCKh 0.93 # 3
SSIM 0.313 # 2
mask-IS 3.872 # 1
mask-SSIM 0.816 # 2

Methods


No methods listed for this paper. Add relevant methods here