Generalizable Novel View Synthesis
14 papers with code • 7 benchmarks • 7 datasets
Benchmarks
These leaderboards are used to track progress in Generalizable Novel View Synthesis
LLFF
ACID
Shiny dataset
RealEstate10K
NERDS 360
Most implemented papers
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
bmild/nerf
•
•
ECCV 2020
Our algorithm represents a scene using a fully-connected (non-convolutional) deep network, whose input is a single continuous 5D coordinate (spatial location $(x, y, z)$ and viewing direction $(\theta, \phi)$) and whose output is the volume density and view-dependent emitted radiance at that spatial location.
pixelNeRF: Neural Radiance Fields from One or Few Images
This allows the network to be trained across multiple scenes to learn a scene prior, enabling it to perform novel view synthesis in a feed-forward manner from a sparse set of views (as few as one).
NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenes
zubair-irshad/NeO-360
•
•
ICCV 2023
NeO 360's representation allows us to learn from a large collection of unbounded 3D scenes while offering generalizability to new views and novel scenes from as few as a single image during inference.
Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Rendering
YoungJoongUNC/Neural_Human_Performer
•
•
NeurIPS 2021
To tackle this, we propose Neural Human Performer, a novel approach that learns generalizable neural radiance fields based on a parametric human body model for robust performance capture.
KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypoints
facebookresearch/KeypointNeRF
•
•
In this work, we investigate common issues with existing spatial encodings and propose a simple yet highly effective approach to modeling high-fidelity volumetric humans from sparse views.
Is Attention All That NeRF Needs?
vita-group/gnt
•
•
While prior works on NeRFs optimize a scene representation by inverting a handcrafted rendering equation, GNT achieves neural representation and rendering that generalizes across scenes using transformers at two stages.
Semantic Ray: Learning a Generalizable Semantic Field with Cross-Reprojection Attention
liuff19/Semantic-Ray
•
•
CVPR 2023
In this paper, we aim to learn a semantic radiance field from multiple scenes that is accurate, efficient and generalizable.
Sat2Density: Faithful Density Learning from Satellite-Ground Image Pairs
qianmingduowan/Sat2Density
•
•
ICCV 2023
This paper aims to develop an accurate 3D geometry representation of satellite images using satellite-ground image pairs.
Entangled View-Epipolar Information Aggregation for Generalizable Neural Radiance Fields
tatakai1/evenerf
•
•
CVPR 2024
Different from existing methods that consider cross-view and along-epipolar information independently, EVE-NeRF conducts the view-epipolar feature aggregation in an entangled manner by injecting the scene-invariant appearance continuity and geometry consistency priors to the aggregation process.
GauHuman: Articulated Gaussian Splatting from Monocular Human Videos
skhu101/gauhuman
•
•
CVPR 2024
We present, GauHuman, a 3D human model with Gaussian Splatting for both fast training (1 ~ 2 minutes) and real-time rendering (up to 189 FPS), compared with existing NeRF-based implicit representation modelling frameworks demanding hours of training and seconds of rendering per frame.
