Search Results for author: Jonathon Luiten

Found 22 papers, 13 papers with code

Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis

no code implementations18 Aug 2023 Jonathon Luiten, Georgios Kopanas, Bastian Leibe, Deva Ramanan

We present a method that simultaneously addresses the tasks of dynamic scene novel-view synthesis and six degree-of-freedom (6-DOF) tracking of all dense scene elements.

Dynamic Reconstruction Novel View Synthesis +1

TarViS: A Unified Approach for Target-based Video Segmentation

1 code implementation CVPR 2023 Ali Athar, Alexander Hermans, Jonathon Luiten, Deva Ramanan, Bastian Leibe

A single TarViS model can be trained jointly on a collection of datasets spanning different tasks, and can hot-swap between tasks during inference without any task-specific retraining.

Ranked #2 on Video Panoptic Segmentation on KITTI-STEP (using extra training data)

Instance Segmentation Segmentation +4

BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in Video

1 code implementation25 Sep 2022 Ali Athar, Jonathon Luiten, Paul Voigtlaender, Tarasha Khurana, Achal Dave, Bastian Leibe, Deva Ramanan

Multiple existing benchmarks involve tracking and segmenting objects in video e. g., Video Object Segmentation (VOS) and Multi-Object Tracking and Segmentation (MOTS), but there is little interaction between them due to the use of disparate benchmark datasets and metrics (e. g. J&F, mAP, sMOTSA).

Ranked #4 on Long-tail Video Object Segmentation on BURST-val (using extra training data)

Long-tail Video Object Segmentation Multi-Object Tracking +6

Differentiable Soft-Masked Attention

1 code implementation1 Jun 2022 Ali Athar, Jonathon Luiten, Alexander Hermans, Deva Ramanan, Bastian Leibe

Recently, "Masked Attention" was proposed in which a given object representation only attends to those image pixel features for which the segmentation mask of that object is active.

Object Segmentation +4

Opening Up Open World Tracking

no code implementations CVPR 2022 Yang Liu, Idil Esen Zulfikar, Jonathon Luiten, Achal Dave, Deva Ramanan, Bastian Leibe, Aljoša Ošep, Laura Leal-Taixé

A benchmark that would allow us to perform an apple-to-apple comparison of existing efforts is a crucial first step towards advancing this important research field.

Ranked #3 on Open-World Video Segmentation on BURST-val (using extra training data)

Multi-Object Tracking Object +1

HODOR: High-level Object Descriptors for Object Re-segmentation in Video Learned from Static Images

1 code implementation CVPR 2022 Ali Athar, Jonathon Luiten, Alexander Hermans, Deva Ramanan, Bastian Leibe

Existing state-of-the-art methods for Video Object Segmentation (VOS) learn low-level pixel-to-pixel correspondences between frames to propagate object masks across video.

Object Semantic Segmentation +2

Opening up Open-World Tracking

no code implementations22 Apr 2021 Yang Liu, Idil Esen Zulfikar, Jonathon Luiten, Achal Dave, Deva Ramanan, Bastian Leibe, Aljoša Ošep, Laura Leal-Taixé

We hope to open a new front in multi-object tracking research that will hopefully bring us a step closer to intelligent systems that can operate safely in the real world.

Multi-Object Tracking Object

UnOVOST: Unsupervised Offline Video Object Segmentation and Tracking

1 code implementation15 Jan 2020 Jonathon Luiten, Idil Esen Zulfikar, Bastian Leibe

UnOVOST even performs competitively with many semi-supervised video object segmentation algorithms even though it is not given any input as to which objects should be tracked and segmented.

Object Segmentation +4

Siam R-CNN: Visual Tracking by Re-Detection

1 code implementation CVPR 2020 Paul Voigtlaender, Jonathon Luiten, Philip H. S. Torr, Bastian Leibe

We present Siam R-CNN, a Siamese re-detection architecture which unleashes the full power of two-stage object detection approaches for visual object tracking.

Object object-detection +4

Single-Shot Panoptic Segmentation

no code implementations2 Nov 2019 Mark Weber, Jonathon Luiten, Bastian Leibe

We present a novel end-to-end single-shot method that segments countable object instances (things) as well as background regions (stuff) into a non-overlapping panoptic segmentation at almost video frame rate.

Decoder Instance Segmentation +5

Track to Reconstruct and Reconstruct to Track

1 code implementation30 Sep 2019 Jonathon Luiten, Tobias Fischer, Bastian Leibe

Object tracking and 3D reconstruction are often performed together, with tracking used as input for reconstruction.

3D Reconstruction Multi-Object Tracking +3

BoLTVOS: Box-Level Tracking for Video Object Segmentation

no code implementations9 Apr 2019 Paul Voigtlaender, Jonathon Luiten, Bastian Leibe

Following this paradigm, we present BoLTVOS (Box-Level Tracking for VOS), which consists of an R-CNN detector conditioned on the first-frame bounding box to detect the object of interest, a temporal consistency rescoring algorithm, and a Box2Seg network that converts bounding boxes to segmentation masks.

Object One-shot visual object segmentation +4

Large-Scale Object Mining for Object Discovery from Unlabeled Video

no code implementations28 Feb 2019 Aljosa Osep, Paul Voigtlaender, Jonathon Luiten, Stefan Breuers, Bastian Leibe

This paper addresses the problem of object discovery from unlabeled driving videos captured in a realistic automotive setting.

Clustering Object +1

4D Generic Video Object Proposals

1 code implementation26 Jan 2019 Aljosa Osep, Paul Voigtlaender, Mark Weber, Jonathon Luiten, Bastian Leibe

Many high-level video understanding methods require input in the form of object proposals.

Instance Segmentation Object +2

Towards Large-Scale Video Video Object Mining

no code implementations19 Sep 2018 Aljosa Osep, Paul Voigtlaender, Jonathon Luiten, Stefan Breuers, Bastian Leibe

We propose to leverage a generic object tracker in order to perform object mining in large-scale unlabeled videos, captured in a realistic automotive setting.

Object

PReMVOS: Proposal-generation, Refinement and Merging for Video Object Segmentation

5 code implementations24 Jul 2018 Jonathon Luiten, Paul Voigtlaender, Bastian Leibe

We address semi-supervised video object segmentation, the task of automatically generating accurate and consistent pixel masks for objects in a video sequence, given the first-frame ground truth annotations.

Object One-shot visual object segmentation +3

Large-Scale Object Discovery and Detector Adaptation from Unlabeled Video

1 code implementation23 Dec 2017 Aljoša Ošep, Paul Voigtlaender, Jonathon Luiten, Stefan Breuers, Bastian Leibe

We explore object discovery and detector adaptation based on unlabeled video sequences captured from a mobile platform.

Autonomous Driving Clustering +3

Cannot find the paper you are looking for? You can Submit a new open access paper.