VGGSfM: Visual Geometry Grounded Deep Structure From Motion

1 code implementation • CVPR 2024 • Jianyuan Wang, Nikita Karaev, Christian Rupprecht, David Novotny

Finally we optimise the cameras and triangulate 3D points via a differentiable bundle adjustment layer.

Camera Calibration Point Tracking

Visual Geometry Grounded Deep Structure From Motion

1 code implementation • 7 Dec 2023 • Jianyuan Wang, Nikita Karaev, Christian Rupprecht, David Novotny

Finally, we optimise the cameras and triangulate 3D points via a differentiable bundle adjustment layer.

Point Tracking

CoTracker: It is Better to Track Together

1 code implementation • 14 Jul 2023 • Nikita Karaev, Ignacio Rocco, Benjamin Graham, Natalia Neverova, Andrea Vedaldi, Christian Rupprecht

We introduce CoTracker, a transformer-based model that tracks dense points in a frame jointly across a video sequence.

motion prediction Object Tracking +2

DynamicStereo: Consistent Dynamic Depth from Stereo Videos

1 code implementation • CVPR 2023 • Nikita Karaev, Ignacio Rocco, Benjamin Graham, Natalia Neverova, Andrea Vedaldi, Christian Rupprecht

The network learns to pool information from neighboring frames to improve the temporal consistency of its predictions.