Search Results for author:
Found 34 papers, 24 papers with code
UniDepth: Universal Monocular Metric Depth Estimation
However, the remarkable accuracy of recent MMDE methods is confined to their training domains.
Ranked #2 on
Monocular Depth Estimation
on NYU-Depth V2
(using extra training data)
Vanishing-Point-Guided Video Semantic Segmentation of Driving Scenes
The estimation of implicit cross-frame correspondences and the high computational cost have long been major challenges in video semantic segmentation (VSS) for driving scenes.
MUSES: The Multi-Sensor Semantic Perception Dataset for Driving under Uncertainty
Achieving level-5 driving automation in autonomous vehicles necessitates a robust semantic visual perception system capable of parsing data from different sensors across diverse conditions.
MuRF: Multi-Baseline Radiance Fields
We present Multi-Baseline Radiance Fields (MuRF), a general feed-forward approach to solving sparse view synthesis under multiple different baseline settings (small and large baselines, and different number of input views).
Real-Time Motion Prediction via Heterogeneous Polyline Transformer with Relative Pose Encoding
The real-world deployment of an autonomous driving system requires its components to run on-board and in real-time, including the motion prediction module that predicts the future trajectories of surrounding traffic participants.
Three Ways to Improve Verbo-visual Fusion for Dense 3D Visual Grounding
A common formulation to tackle 3D visual grounding is grounding-by-detection, where localization is done via bounding boxes.
Condition-Invariant Semantic Segmentation
Motivated by these findings, we propose to leverage stylization in performing feature-level adaptation by aligning the internal network features extracted by the encoder of the network from the original and the stylized view of each input image with a novel feature invariance loss.
Maskomaly:Zero-Shot Mask Anomaly Segmentation
We present a simple and practical framework for anomaly segmentation called Maskomaly.
Indiscernible Object Counting in Underwater Scenes
We further advance the frontier of this field by systematically studying a new challenge named indiscernible object counting (IOC), the goal of which is to count objects that are blended with respect to their surroundings.
Advances in Deep Concealed Scene Understanding
Concealed scene understanding (CSU) is a hot computer vision topic aiming to perceive objects exhibiting camouflage.
iDisc: Internal Discretization for Monocular Depth Estimation
Our method sets the new state of the art with significant improvements on NYU-Depth v2 and KITTI, outperforming all published methods on the official KITTI benchmark.
Ranked #3 on
Surface Normals Estimation
on NYU Depth v2
CamDiff: Camouflage Image Augmentation via Diffusion Model
Specifically, we leverage the latent diffusion model to synthesize salient objects in camouflaged scenes, while using the zero-shot image classification ability of the Contrastive Language-Image Pre-training (CLIP) model to prevent synthesis failures and ensure the synthesized object aligns with the input prompt.
OVeNet: Offset Vector Network for Semantic Segmentation
Motivated by this prior, we design a novel two-head network, named Offset Vector Network (OVeNet), which generates both standard semantic predictions and a dense 2D offset vector field indicating the offset from each pixel to the respective seed pixel, which is used to compute an alternative, seed-based semantic prediction.
Lidar Line Selection with Spatially-Aware Shapley Value for Cost-Efficient Depth Completion
Lidar is a vital sensor for estimating the depth of a scene.
Contrastive Model Adaptation for Cross-Condition Robustness in Semantic Segmentation
We investigate normal-to-adverse condition model adaptation for semantic segmentation, whereby image-level correspondences are available in the target domain.
Ranked #1 on
Source-Free Domain Adaptation
on Cityscapes to ACDC
Event-Based Frame Interpolation with Ad-hoc Deblurring
The performance of video frame interpolation is inherently correlated with the ability to handle motion in the input scene.
Masked Vision-Language Transformer in Fashion
We present a masked vision-language transformer (MVLT) for fashion-specific multi-modal representation.
TT-NF: Tensor Train Neural Fields
Learning neural fields has been an active topic in deep learning research, focusing, among other issues, on finding more compact and easy-to-fit representations.
Refign: Align and Refine for Adaptation of Semantic Segmentation to Adverse Conditions
Due to the scarcity of dense pixel-level semantic annotations for images recorded in adverse visual conditions, there has been a keen interest in unsupervised domain adaptation (UDA) for the semantic segmentation of such images.
Ranked #1 on
Semantic Segmentation
on Dark Zurich
L2E: Lasers to Events for 6-DoF Extrinsic Calibration of Lidars and Event Cameras
As neuromorphic technology is maturing, its application to robotics and autonomous vehicle systems has become an area of active research.
HRFuser: A Multi-resolution Sensor Fusion Architecture for 2D Object Detection
Besides standard cameras, autonomous vehicles typically include multiple additional sensors, such as lidars and radars, which help acquire richer information for perceiving the content of the driving scene.
Ranked #1 on
2D Object Detection
on Clear Weather
P3Depth: Monocular Depth Estimation with a Piecewise Planarity Prior
We focus on the supervised setup, in which ground-truth depth is available only at training time.
Ranked #6 on
Depth Estimation
on NYU-Depth V2
LiDAR Snowfall Simulation for Robust 3D Object Detection
Due to the difficulty of collecting and annotating training data in this setting, we propose a physically based method to simulate the effect of snowfall on real clear-weather LiDAR point clouds.
Ranked #1 on
3D Object Detection
on Heavy Snowfall
Event-Based Fusion for Motion Deblurring with Cross-modal Attention
Traditional frame-based cameras inevitably suffer from motion blur due to long exposure times.
Ranked #3 on
Deblurring
on GoPro
(using extra training data)
Fog Simulation on Real LiDAR Point Clouds for 3D Object Detection in Adverse Weather
2) Through extensive experiments with several state-of-the-art detection approaches, we show that our fog simulation can be leveraged to significantly improve the performance for 3D object detection in the presence of fog.
Ranked #1 on
3D Object Detection
on Dense Fog
ACDC: The Adverse Conditions Dataset with Correspondences for Semantic Driving Scene Understanding
To address this, we introduce ACDC, the Adverse Conditions Dataset with Correspondences for training and testing semantic segmentation methods on adverse visual conditions.
Map-Guided Curriculum Domain Adaptation and Uncertainty-Aware Evaluation for Semantic Nighttime Image Segmentation
Our central contributions are: 1) a curriculum framework to gradually adapt semantic segmentation models from day to night through progressively darker times of day, exploiting cross-time-of-day correspondences between daytime images from a reference map and dark images to guide the label inference in the dark domains; 2) a novel uncertainty-aware annotation and evaluation framework and metric for semantic segmentation, including image regions beyond human recognition capability in the evaluation in a principled fashion; 3) the Dark Zurich dataset, comprising 2416 unlabeled nighttime and 2920 unlabeled twilight images with correspondences to their daytime counterparts plus a set of 201 nighttime images with fine pixel-level annotations created with our protocol, which serves as a first benchmark for our novel evaluation.
Ranked #5 on
Semantic Segmentation
on Nighttime Driving
Semantic Understanding of Foggy Scenes with Purely Synthetic Data
This work addresses the problem of semantic scene understanding under foggy road conditions.
Guided Curriculum Model Adaptation and Uncertainty-Aware Evaluation for Semantic Nighttime Image Segmentation
Our central contributions are: 1) a curriculum framework to gradually adapt semantic segmentation models from day to night via labeled synthetic images and unlabeled real images, both for progressively darker times of day, which exploits cross-time-of-day correspondences for the real images to guide the inference of their labels; 2) a novel uncertainty-aware annotation and evaluation framework and metric for semantic segmentation, designed for adverse conditions and including image regions beyond human recognition capability in the evaluation in a principled fashion; 3) the Dark Zurich dataset, which comprises 2416 unlabeled nighttime and 2920 unlabeled twilight images with correspondences to their daytime counterparts plus a set of 151 nighttime images with fine pixel-level annotations created with our protocol, which serves as a first benchmark to perform our novel evaluation.
Ranked #7 on
Semantic Segmentation
on Nighttime Driving
Curriculum Model Adaptation with Synthetic and Real Data for Semantic Foggy Scene Understanding
The method is based on the fact that the results of semantic segmentation in moderately adverse conditions (light fog) can be bootstrapped to solve the same problem in highly adverse conditions (dense fog).
Ranked #5 on
Domain Adaptation
on Cityscapes-to-FoggyDriving
Model Adaptation with Synthetic and Real Data for Semantic Dense Foggy Scene Understanding
In addition, we present three other main stand-alone contributions: 1) a novel method to add synthetic fog to real, clear-weather scenes using semantic input; 2) a new fog density estimator; 3) the Foggy Zurich dataset comprising $3808$ real foggy images, with pixel-level semantic annotations for $16$ images with dense fog.
Domain Adaptive Faster R-CNN for Object Detection in the Wild
The results demonstrate the effectiveness of our proposed approach for robust object detection in various domain shift scenarios.
Semantic Foggy Scene Understanding with Synthetic Data
Due to the difficulty of collecting and annotating foggy images, we choose to generate synthetic fog on real images that depict clear-weather outdoor scenes, and then leverage these partially synthetic data for SFSU by employing state-of-the-art convolutional neural networks (CNN).
Theoretical Analysis of Active Contours on Graphs
Active contour models based on partial differential equations have proved successful in image segmentation, yet the study of their geometric formulation on arbitrary geometric graphs is still at an early stage.
