About

Synthesize a target image with an arbitrary target camera pose from given source images and their camera poses.

( Image credit: Multi-view to Novel view: Synthesizing novel views with Self-Learned Confidence )

Benchmarks

TREND DATASET BEST METHOD PAPER TITLE PAPER CODE COMPARE

Datasets

Greatest papers with code

3D Photography using Context-aware Layered Depth Inpainting

CVPR 2020 vt-vl-lab/3d-photo-inpainting

We propose a method for converting a single RGB-D input image into a 3D photo - a multi-layer representation for novel view synthesis that contains hallucinated color and depth structures in regions occluded in the original view.

NOVEL VIEW SYNTHESIS

SynSin: End-to-end View Synthesis from a Single Image

CVPR 2020 facebookresearch/pytorch3d

Single image view synthesis allows for the generation of new views of a scene given a single input image.

NOVEL VIEW SYNTHESIS

NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis

ECCV 2020 facebookresearch/pytorch3d

Our algorithm represents a scene using a fully-connected (non-convolutional) deep network, whose input is a single continuous 5D coordinate (spatial location $(x, y, z)$ and viewing direction $(\theta, \phi)$) and whose output is the volume density and view-dependent emitted radiance at that spatial location.

NEURAL RENDERING NOVEL VIEW SYNTHESIS

Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesis

ICCV 2019 svip-lab/impersonator

In this paper, we propose to use a 3D body mesh recovery module to disentangle the pose and shape, which can not only model the joint location and rotation but also characterize the personalized body shape.

DENOISING NOVEL VIEW SYNTHESIS

Liquid Warping GAN with Attention: A Unified Framework for Human Image Synthesis

18 Nov 2020iPERDance/iPERCore

Also, we build a new dataset, namely iPER dataset, for the evaluation of human motion imitation, appearance transfer, and novel view synthesis.

DENOISING IMAGE GENERATION NOVEL VIEW SYNTHESIS

Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines

2 May 2019Fyusion/LLFF

We present a practical and robust deep learning solution for capturing and rendering novel views of complex real world scenes for virtual exploration.

NOVEL VIEW SYNTHESIS

View Synthesis by Appearance Flow

11 May 2016RenYurui/Global-Flow-Local-Attention

We address the problem of novel view synthesis: given an input image, synthesizing new images of the same object or scene observed from arbitrary viewpoints.

NOVEL VIEW SYNTHESIS

pixelNeRF: Neural Radiance Fields from One or Few Images

3 Dec 2020sxyu/pixel-nerf

This allows the network to be trained across multiple scenes to learn a scene prior, enabling it to perform novel view synthesis in a feed-forward manner from a sparse set of views (as few as one).

3D RECONSTRUCTION NOVEL VIEW SYNTHESIS

Stereo Magnification: Learning View Synthesis using Multiplane Images

24 May 2018google/stereo-magnification

The view synthesis problem--generating novel views of a scene from known imagery--has garnered recent attention due in part to compelling applications in virtual and augmented reality.

NOVEL VIEW SYNTHESIS