Wide-Context Semantic Image Extrapolation
This paper studies the fundamental problem of extrapolating visual context using deep generative models, i.e., extending image borders with plausible structure and details. This seemingly easy task actually faces many crucial technical challenges and has its unique properties. The two major issues are size expansion and one-side constraints. We propose a semantic regeneration network with several special contributions and use multiple spatial related losses to address these issues. Our results contain consistent structures and high-quality textures. Extensive experiments are conducted on various possible alternatives and related methods. We also explore the potential of our method for various interesting applications that can benefit research in a variety of fields.
PDF Abstract
Datasets
Cityscapes
Places
CelebA-HQ
DeepFashion
KITTI360-EX
| Task | Dataset | Model | Metric Name | Metric Value | Global Rank | Benchmark |
|---|---|---|---|---|---|---|
| Seeing Beyond the Visible | KITTI360-EX | SRN | Average PSNR | 16.10 | # 7 |
