Search Results for author:
Found 43 papers, 33 papers with code
MambaMOS: LiDAR-based 3D Moving Object Segmentation with Motion-aware State Space Model
In this paper, we propose a novel LiDAR-based 3D Moving Object Segmentation with Motion-aware State Space Model, termed MambaMOS.
Real-World Computational Aberration Correction via Quantized Domain-Mixing Representation
Relying on paired synthetic data, existing learning-based Computational Aberration Correction (CAC) methods are confronted with the intricate and multifaceted synthetic-to-real domain gap, which leads to suboptimal performance in real-world applications.
OccFiner: Offboard Occupancy Refinement with Hybrid Propagation
Vision-based occupancy prediction, also known as 3D Semantic Scene Completion (SSC), presents a significant challenge in computer vision.
SGE: Structured Light System Based on Gray Code with an Event Camera
Event camera, as a device that quickly responds to intensity changes, provides a new solution for structured light (SL) systems.
Temporal-Mapping Photography for Event Cameras
Different from traditional methods that mainly rely on event integration, the proposed Event-Based Temporal Mapping Photography (EvTemMap) measures the time of event emitting for each pixel.
Rethinking Event-based Human Pose Estimation with 3D Event Representations
Experiments on EV-3DPW demonstrate that the robustness of our proposed 3D representation methods compared to traditional RGB images and event frame techniques under the same backbones.
CoBEV: Elevating Roadside 3D Object Detection with Depth and Height Complementarity
Roadside camera-driven 3D object detection is a crucial task in intelligent transportation systems, which extends the perception range beyond the limitations of vision-centric vehicles and enhances road safety.
Ranked #2 on
3D Object Detection
on Rope3D
FocusFlow: Boosting Key-Points Optical Flow Estimation for Autonomous Driving
Based on the modeling method, we present FocusFlow, a framework consisting of 1) a mix loss function combined with a classic photometric loss function and our proposed Conditional Point Control Loss (CPCL) function for diverse point-wise supervision; 2) a conditioned controlling model which substitutes the conventional feature encoder by our proposed Condition Control Encoder (CCE).
A Multi-Scale Recurrent Framework for Motion Segmentation With Event Camera
Motion segmentation is a formidable computer vision task, aiming to segment moving targets from a dynamic scene.
Towards Anytime Optical Flow Estimation with Event Cameras
We then propose EVA-Flow, an EVent-based Anytime Flow estimation network to produce high-frame-rate event optical flow with only low-frame-rate optical flow ground truth for supervision.
Minimalist and High-Quality Panoramic Imaging with PSF-aware Transformers
In this paper, we propose a Panoramic Computational Imaging Engine (PCIE) to address minimalist and high-quality panoramic imaging.
LF-PGVIO: A Visual-Inertial-Odometry Framework for Large Field-of-View Cameras using Points and Geodesic Segments
The purpose of our research is to unleash the potential of point-line odometry with large-FoV omnidirectional cameras, even for cameras with negative-plane FoV.
FishDreamer: Towards Fisheye Semantic Completion via Unified Image Outpainting and Segmentation
This paper raises the new task of Fisheye Semantic Completion (FSC), where dense texture, structure, and semantics of a fisheye image are inferred even beyond the sensor field-of-view (FoV).
PanoVPR: Towards Unified Perspective-to-Equirectangular Visual Place Recognition via Sliding Windows across the Panoramic View
To address this, we propose \textit{PanoVPR}, a perspective-to-equirectangular (P2E) visual place recognition framework that employs sliding windows to eliminate feature truncation caused by hard cropping.
Improving Fast Auto-Focus with Event Polarity
Specifically, the symmetrical relationship between the event polarities in focusing is investigated, and the event-based focus evaluation function is proposed based on the principles of the event cameras and the imaging model in the focusing process.
Delivering Arbitrary-Modal Semantic Segmentation
To make this possible, we present the arbitrary cross-modal segmentation model CMNeXt.
Ranked #1 on
Semantic Segmentation
on DSEC
Event-Based Frame Interpolation with Ad-hoc Deblurring
The performance of video frame interpolation is inherently correlated with the ability to handle motion in the input scene.
Computational Imaging for Machine Perception: Transferring Semantic Segmentation beyond Aberrations
Further, we propose Computational Imaging Assisted Domain Adaptation (CIADA) to leverage prior knowledge of CI for robust performance in SSOA.
Beyond the Field-of-View: Enhancing Scene Visibility and Perception with Clip-Recurrent Transformer
In this paper, we propose the concept of online video inpainting for autonomous vehicles to expand the field of view, thereby enhancing scene visibility, perception, and system safety.
Ranked #1 on
Seeing Beyond the Visible
on KITTI360-EX
LF-VISLAM: A SLAM Framework for Large Field-of-View Cameras with Negative Imaging Plane on Mobile Agents
As loop closure on wide-FoV panoramic data further comes with a large number of outliers, traditional outlier rejection methods are not directly applicable.
Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentation
In this paper, we address panoramic semantic segmentation which is under-explored due to two critical challenges: (1) image distortions and object deformations on panoramas; (2) lack of semantic annotations in the 360-degree imagery.
Ranked #1 on
Semantic Segmentation
on SynPASS
Annular Computational Imaging: Capture Clear Panoramic Images through Simple Lens
In this paper, we propose an Annular Computational Imaging (ACI) framework to break the optical limit of light-weight PAL design.
Efficient Human Pose Estimation via 3D Event Point Cloud
We then leverage the rasterized event point cloud as input to three different backbones, PointNet, DGCNN, and Point Transformer, with two linear layer decoders to predict the location of human keypoints.
Ranked #1 on
3D Human Pose Estimation
on DHP19
Review on Panoramic Imaging and Its Applications in Scene Understanding
However, while satisfying the need for large-FoV photographic imaging, panoramic imaging instruments are expected to have high resolution, no blind area, miniaturization, and multidimensional intelligent perception, and can be combined with artificial intelligence methods towards the next generation of intelligent instruments, enabling deeper understanding and more holistic perception of 360-degree real-world surrounding environments.
PanoFlow: Learning 360° Optical Flow for Surrounding Temporal Understanding
PanoFlow achieves state-of-the-art performance on the public OmniFlowNet and the established FlowScape benchmarks.
LF-VIO: A Visual-Inertial-Odometry Framework for Large Field-of-View Cameras with Negative Plane
To tackle this issue, we propose LF-VIO, a real-time VIO framework for cameras with extremely large FoV.
CSFlow: Learning Optical Flow via Cross Strip Correlation for Autonomous Driving
In this paper, we propose a new deep network architecture for optical flow estimation in autonomous driving--CSFlow, which consists of two novel modules: Cross Strip Correlation module (CSC) and Correlation Regression Initialization module (CRI).
Event-Based Fusion for Motion Deblurring with Cross-modal Attention
Traditional frame-based cameras inevitably suffer from motion blur due to long exposure times.
Ranked #3 on
Deblurring
on GoPro
(using extra training data)
Panoramic Depth Estimation via Supervised and Unsupervised Learning in Indoor Scenes
With a comprehensive variety of experiments, this research demonstrates the effectiveness of our schemes aiming for indoor scene perception.
Aerial-PASS: Panoramic Annular Scene Segmentation in Drone Videos
A lightweight panoramic annular semantic segmentation neural network model is designed to achieve high-accuracy and real-time scene parsing.
Ranked #69 on
Semantic Segmentation
on Cityscapes val
Panoramic annular SLAM with loop closure and global optimization
In this paper, we propose panoramic annular simultaneous localization and mapping (PA-SLAM), a visual SLAM system based on panoramic annular lens.
Loop Closure Detection
Simultaneous Localization and Mapping
Polarization-driven Semantic Segmentation via Efficient Attention-bridged Fusion
Semantic Segmentation (SS) is promising for outdoor scene perception in safety-critical applications like autonomous vehicles, assisted navigation and so on.
Ranked #5 on
Semantic Segmentation
on UPLight
Real-time Fusion Network for RGB-D Semantic Segmentation Incorporating Unexpected Obstacle Detection for Road-driving Images
Semantic segmentation has made striking progress due to the success of deep convolutional neural networks.
Ranked #11 on
Semantic Segmentation
on EventScape
Universal Semantic Segmentation for Fisheye Urban Driving Images
In this paper, a seven degrees of freedom (DoF) augmentation method is proposed to transform rectilinear image to fisheye image in a more comprehensive way.
DS-PASS: Detail-Sensitive Panoramic Annular Semantic Segmentation through SwaftNet for Surrounding Sensing
Semantically interpreting the traffic scene is crucial for autonomous transportation and robotics systems.
Ranked #35 on
Semantic Segmentation
on DensePASS
OpenMPR: Recognize Places Using Multimodal Data for People with Visual Impairments
Place recognition plays a crucial role in navigational assistance, and is also a challenging issue of assistive technology.
Semantic Segmentation of Panoramic Images Using a Synthetic Dataset
In addition, it has been shown that by using panoramic images with a 180 degree FoV as training data the model has better performance.
See Clearer at Night: Towards Robust Nighttime Semantic Segmentation through Day-Night Image Conversion
However, in face of adverse conditions such as the nighttime, semantic segmentation loses its accuracy significantly.
Ranked #8 on
Semantic Segmentation
on Nighttime Driving
A Comparative Study of High-Recall Real-Time Semantic Segmentation Based on Swift Factorized Network
Furthermore, we make a detailed analysis and comparison of the three proposed methods on the promotion of recall rate.
Importance-Aware Semantic Segmentation with Efficient Pyramidal Context Network for Navigational Assistant Systems
Semantic Segmentation (SS) is a task to assign semantic label to each pixel of the images, which is of immense significance for autonomous vehicles, robotics and assisted navigation of vulnerable road users.
ACNet: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation
The main contributions lie in the Attention Complementary Module (ACM) and the architecture with three parallel branches.
Ranked #4 on
Semantic Segmentation
on KITTI-360
Panoramic Annular Localizer: Tackling the Variation Challenges of Outdoor Localization Using Panoramic Annular Images and Active Deep Descriptors
The panoramic annular images captured by the single camera are processed and fed into the NetVLAD network to form the active deep descriptor, and sequential matching is utilized to generate the localization result.
Visual Localization of Key Positions for Visually Impaired People
On the off-the-shelf navigational assistance devices, the localization precision is limited to the signal error of global navigation satellite system (GNSS).
