Neural Rendering
25 papers with code • 0 benchmarks • 1 datasets
Given a representation of a 3D scene of some kind (point cloud, mesh, voxels, etc.), the task is to create an algorithm that can produce photorealistic renderings of this scene from an arbitrary viewpoint. Sometimes, the task is accompanied by image/scene appearance manipulation.
Benchmarks
SyntheticFur
Greatest papers with code
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
facebookresearch/pytorch3d
•
•
ECCV 2020
Our algorithm represents a scene using a fully-connected (non-convolutional) deep network, whose input is a single continuous 5D coordinate (spatial location $(x, y, z)$ and viewing direction $(\theta, \phi)$) and whose output is the volume density and view-dependent emitted radiance at that spatial location.
GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields
autonomousvision/giraffe
•
•
CVPR 2021
While several recent works investigate how to disentangle underlying factors of variation in the data, most of them operate in 2D and hence ignore that our world is three-dimensional.
Spatial Broadcast Decoder: A Simple Architecture for Learning Disentangled Representations in VAEs
We present a simple neural rendering architecture that helps variational autoencoders (VAEs) learn disentangled representations.
PlenOctrees for Real-time Rendering of Neural Radiance Fields
sxyu/volrend
•
•
We introduce a method to render Neural Radiance Fields (NeRFs) in real time using PlenOctrees, an octree-based 3D representation which supports view-dependent effects.
Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatars
saic-violet/bilayer-model
•
•
ECCV 2020
The texture image is generated offline, warped and added to the coarse image to ensure a high effective resolution of synthesized head views.
MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo
We present MVSNeRF, a novel neural rendering approach that can efficiently reconstruct neural radiance fields for view synthesis.
A Neural Rendering Framework for Free-Viewpoint Relighting
apchenstu/mvsnerf
•
•
CVPR 2020
We present a novel Relightable Neural Renderer (RNR) for simultaneous view synthesis and relighting using multi-view image inputs.
Deferred Neural Rendering: Image Synthesis using Neural Textures
Similar to traditional textures, neural textures are stored as maps on top of 3D mesh proxies; however, the high-dimensional feature maps contain significantly more information, which can be interpreted by our new deferred neural rendering pipeline.
CONFIG: Controllable Neural Face Image Generation
microsoft/ConfigNet
•
•
ECCV 2020
Our ability to sample realistic natural images, particularly faces, has advanced by leaps and bounds in recent years, yet our ability to exert fine-tuned control over the generative process has lagged behind.
AutoInt: Automatic Integration for Fast Neural Volume Rendering
computational-imaging/automatic-integration
•
•
CVPR 2021
For training, we instantiate the computational graph corresponding to the derivative of the network.