We reformulate the NeRF to also directly output the visibility of a 3D point from a given viewpoint to reduce the training time with the visibility constraint.
The predicted object motion is then integrated with the given user or camera motion to generate the next frame.
Ranked #1 on Video Prediction on MPI Sintel
We consider the problem of temporal view synthesis, where the goal is to predict a future video frame from the past frames using knowledge of the depth and relative camera motion.
Ranked #1 on Temporal View Synthesis on SceneNet RGB-D
We show that our feature design leads to state of the art quality prediction in accordance with human judgments on our IISc PVQA Database.