Novel View Synthesis

307 papers with code • 17 benchmarks • 33 datasets

Synthesize a target image with an arbitrary target camera pose from given source images and their camera poses.

See Wiki for more introdcutions.

The Synthesis method include: NeRF, MPI and so on.

( Image credit: Multi-view to Novel view: Synthesizing novel views with Self-Learned Confidence )

Libraries

Use these libraries to find Novel View Synthesis models and implementations

PKU-DyMVHumans: A Multi-View Video Benchmark for High-Fidelity Dynamic Human Modeling

zhengxyun/PKU-DyMVHumans 24 Mar 2024

To facilitate the development of these fields, in this paper, we present PKU-DyMVHumans, a versatile human-centric dataset for high-fidelity reconstruction and rendering of dynamic human scenarios from dense multi-view videos.

2
24 Mar 2024

MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Images

donydchen/mvsplat 21 Mar 2024

We propose MVSplat, an efficient feed-forward 3D Gaussian Splatting model learned from sparse multi-view images.

262
21 Mar 2024

HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression

yihangchen-ee/hac 21 Mar 2024

3D Gaussian Splatting (3DGS) has emerged as a promising framework for novel view synthesis, boasting rapid rendering speed with high fidelity.

60
21 Mar 2024

CombiNeRF: A Combination of Regularization Techniques for Few-Shot Neural Radiance Field View Synthesis

sarroccoluigi/combinerf 21 Mar 2024

When dealing with few-shot settings, i. e. with a small set of input views, the training could overfit those views, leading to artifacts and geometric and chromatic inconsistencies in the resulting rendering.

3
21 Mar 2024

Gaussian Splatting on the Move: Blur and Rolling Shutter Compensation for Natural Camera Motion

spectacularai/3dgs-deblur 20 Mar 2024

High-quality scene reconstruction and novel view synthesis based on Gaussian Splatting (3DGS) typically require steady, high-quality photographs, often impractical to capture with handheld cameras.

41
20 Mar 2024

BAD-Gaussians: Bundle Adjusted Deblur Gaussian Splatting

WU-CVGL/BAD-Gaussians 18 Mar 2024

In this paper, we introduce a novel approach, named BAD-Gaussians (Bundle Adjusted Deblur Gaussian Splatting), which leverages explicit Gaussian representation and handles severe motion-blurred images with inaccurate camera poses to achieve high-quality scene reconstruction.

63
18 Mar 2024

Aerial Lifting: Neural Urban Semantic and Building Instance Lifting from Aerial Imagery

zyqz97/aerial_lifting 18 Mar 2024

We then introduce a novel cross-view instance label grouping strategy based on the 3D scene representation to mitigate the multi-view inconsistency problem in the 2D instance labels.

15
18 Mar 2024

ThermoNeRF: Multimodal Neural Radiance Fields for Thermal Novel View Synthesis

schindlerepfl/thermo-nerf 18 Mar 2024

Thermal scene reconstruction exhibit great potential for ap- plications across a broad spectrum of fields, including building energy consumption analysis and non-destructive testing.

7
18 Mar 2024

Relaxing Accurate Initialization Constraint for 3D Gaussian Splatting

KU-CVLAB/RAIN-GS 14 Mar 2024

Through extensive analysis of SfM initialization in the frequency domain and analysis of a 1D regression task with multiple 1D Gaussians, we propose a novel optimization strategy dubbed RAIN-GS (Relaxing Accurate Initialization Constraint for 3D Gaussian Splatting), that successfully trains 3D Gaussians from random point clouds.

199
14 Mar 2024

V3D: Video Diffusion Models are Effective 3D Generators

heheyas/v3d 11 Mar 2024

To fully unleash the potential of video diffusion to perceive the 3D world, we further introduce geometrical consistency prior and extend the video diffusion model to a multi-view consistent 3D generator.

339
11 Mar 2024