Image Outpainting
22 papers with code • 3 benchmarks • 4 datasets
Predicting the visual context of an image beyond its boundary.
Image credit: NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis
Benchmarks
These leaderboards are used to track progress in Image Outpainting
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
|||||
|
MS COCO
MSCOCO
Places365
LHQ
Latest papers
Continuous-Multiple Image Outpainting in One-Step via Positional Query and A Diffusion-based Approach
At inference, we generate images with arbitrary expansion multiples by inputting an anchor image and its corresponding positional embeddings.
FishDreamer: Towards Fisheye Semantic Completion via Unified Image Outpainting and Segmentation
This paper raises the new task of Fisheye Semantic Completion (FSC), where dense texture, structure, and semantics of a fisheye image are inferred even beyond the sensor field-of-view (FoV).
SinDiffusion: Learning a Diffusion Model from a Single Natural Image
We present SinDiffusion, leveraging denoising diffusion models to capture internal distribution of patches from a single natural image.
NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis
In this paper, we present NUWA-Infinity, a generative model for infinite visual synthesis, which is defined as the task of generating arbitrarily-sized high-resolution images or long-duration videos.
Outpainting by Queries
kaiseem/queryotr
•
•
Image outpainting, which is well studied with Convolution Neural Network (CNN) based framework, has recently drawn more attention in computer vision.
FisheyeEX: Polar Outpainting for Extending the FoV of Fisheye Lens
For the distortion synthesis, we propose a spiral distortion-aware perception module, in which the learning path keeps consistent with the distortion prior of the fisheye image.
Cylin-Painting: Seamless {360\textdegree} Panoramic Image Outpainting and Beyond
kangliao929/cylin-painting
•
•
Motivated by this analysis, we present a Cylin-Painting framework that involves meaningful collaborations between inpainting and outpainting and efficiently fuses the different arrangements, with a view to leveraging their complementary benefits on a seamless cylinder.
Diverse Plausible 360-Degree Image Outpainting for Efficient 3DCG Background Creation
akmtn/OmniDreamer
•
•
CVPR 2022
To improve the properties of a 360-degree image on an output image, we also propose WS-perceptual loss and circular inference.
MaskGIT: Masked Generative Image Transformer
lucidrains/soundstorm-pytorch
•
•
CVPR 2022
At inference time, the model begins with generating all tokens of an image simultaneously, and then refines the image iteratively conditioned on the previous generation.
Generalised Image Outpainting with U-Transformer
In this paper, we develop a novel transformer-based generative adversarial neural network called U-Transformer for generalised image outpainting problem.
