Search Results for author: Jonathon Luiten

Found 19 papers, 11 papers with code

TarViS: A Unified Approach for Target-based Video Segmentation

no code implementations6 Jan 2023 Ali Athar, Alexander Hermans, Jonathon Luiten, Deva Ramanan, Bastian Leibe

A single TarViS model can be trained jointly on a collection of datasets spanning different tasks, and can hot-swap between tasks during inference without any task-specific retraining.

Instance Segmentation Panoptic Segmentation +5

BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in Video

1 code implementation25 Sep 2022 Ali Athar, Jonathon Luiten, Paul Voigtlaender, Tarasha Khurana, Achal Dave, Bastian Leibe, Deva Ramanan

Multiple existing benchmarks involve tracking and segmenting objects in video e. g., Video Object Segmentation (VOS) and Multi-Object Tracking and Segmentation (MOTS), but there is little interaction between them due to the use of disparate benchmark datasets and metrics (e. g. J&F, mAP, sMOTSA).

Multi-Object Tracking Multi-Object Tracking and Segmentation +4

Differentiable Soft-Masked Attention

1 code implementation1 Jun 2022 Ali Athar, Jonathon Luiten, Alexander Hermans, Deva Ramanan, Bastian Leibe

Recently, "Masked Attention" was proposed in which a given object representation only attends to those image pixel features for which the segmentation mask of that object is active.

Semantic Segmentation Video Object Segmentation +2

Opening Up Open World Tracking

no code implementations CVPR 2022 Yang Liu, Idil Esen Zulfikar, Jonathon Luiten, Achal Dave, Deva Ramanan, Bastian Leibe, Aljoša Ošep, Laura Leal-Taixé

A benchmark that would allow us to perform an apple-to-apple comparison of existing efforts is a crucial first step towards advancing this important research field.

Multi-Object Tracking

HODOR: High-level Object Descriptors for Object Re-segmentation in Video Learned from Static Images

1 code implementation CVPR 2022 Ali Athar, Jonathon Luiten, Alexander Hermans, Deva Ramanan, Bastian Leibe

Existing state-of-the-art methods for Video Object Segmentation (VOS) learn low-level pixel-to-pixel correspondences between frames to propagate object masks across video.

Semantic Segmentation Video Object Segmentation +1

Opening up Open-World Tracking

no code implementations22 Apr 2021 Yang Liu, Idil Esen Zulfikar, Jonathon Luiten, Achal Dave, Deva Ramanan, Bastian Leibe, Aljoša Ošep, Laura Leal-Taixé

We hope to open a new front in multi-object tracking research that will hopefully bring us a step closer to intelligent systems that can operate safely in the real world.

Multi-Object Tracking

UnOVOST: Unsupervised Offline Video Object Segmentation and Tracking

1 code implementation15 Jan 2020 Jonathon Luiten, Idil Esen Zulfikar, Bastian Leibe

UnOVOST even performs competitively with many semi-supervised video object segmentation algorithms even though it is not given any input as to which objects should be tracked and segmented.

Association Semantic Segmentation +3

Siam R-CNN: Visual Tracking by Re-Detection

1 code implementation CVPR 2020 Paul Voigtlaender, Jonathon Luiten, Philip H. S. Torr, Bastian Leibe

We present Siam R-CNN, a Siamese re-detection architecture which unleashes the full power of two-stage object detection approaches for visual object tracking.

object-detection Object Detection +3

Single-Shot Panoptic Segmentation

no code implementations2 Nov 2019 Mark Weber, Jonathon Luiten, Bastian Leibe

We present a novel end-to-end single-shot method that segments countable object instances (things) as well as background regions (stuff) into a non-overlapping panoptic segmentation at almost video frame rate.

Instance Segmentation object-detection +2

Track to Reconstruct and Reconstruct to Track

1 code implementation30 Sep 2019 Jonathon Luiten, Tobias Fischer, Bastian Leibe

Object tracking and 3D reconstruction are often performed together, with tracking used as input for reconstruction.

3D Reconstruction Multi-Object Tracking +1

BoLTVOS: Box-Level Tracking for Video Object Segmentation

no code implementations9 Apr 2019 Paul Voigtlaender, Jonathon Luiten, Bastian Leibe

Following this paradigm, we present BoLTVOS (Box-Level Tracking for VOS), which consists of an R-CNN detector conditioned on the first-frame bounding box to detect the object of interest, a temporal consistency rescoring algorithm, and a Box2Seg network that converts bounding boxes to segmentation masks.

One-shot visual object segmentation Semantic Segmentation +2

Large-Scale Object Mining for Object Discovery from Unlabeled Video

no code implementations28 Feb 2019 Aljosa Osep, Paul Voigtlaender, Jonathon Luiten, Stefan Breuers, Bastian Leibe

This paper addresses the problem of object discovery from unlabeled driving videos captured in a realistic automotive setting.

Object Discovery

Towards Large-Scale Video Video Object Mining

no code implementations19 Sep 2018 Aljosa Osep, Paul Voigtlaender, Jonathon Luiten, Stefan Breuers, Bastian Leibe

We propose to leverage a generic object tracker in order to perform object mining in large-scale unlabeled videos, captured in a realistic automotive setting.

PReMVOS: Proposal-generation, Refinement and Merging for Video Object Segmentation

5 code implementations24 Jul 2018 Jonathon Luiten, Paul Voigtlaender, Bastian Leibe

We address semi-supervised video object segmentation, the task of automatically generating accurate and consistent pixel masks for objects in a video sequence, given the first-frame ground truth annotations.

One-shot visual object segmentation Semantic Segmentation +1

Large-Scale Object Discovery and Detector Adaptation from Unlabeled Video

1 code implementation23 Dec 2017 Aljoša Ošep, Paul Voigtlaender, Jonathon Luiten, Stefan Breuers, Bastian Leibe

We explore object discovery and detector adaptation based on unlabeled video sequences captured from a mobile platform.

Autonomous Driving Object Discovery +1

Cannot find the paper you are looking for? You can Submit a new open access paper.