Search Results for author:
Found 51 papers, 37 papers with code
Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentation
In this paper, we propose MUTR, a Multi-modal Unified Temporal transformer for Referring video object segmentation.
Referring Video Object Segmentation
Semantic Segmentation
+1
Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Driving
End-to-end autonomous driving has made impressive progress in recent years.
A Strong and Reproducible Object Detector with Only Public Datasets
This work presents Focal-Stable-DINO, a strong and reproducible object detection model which achieves 64. 6 AP on COCO val2017 and 64. 8 AP on COCO test-dev using only 700M parameters without any test time augmentation.
Ranked #3 on
Object Detection
on COCO test-dev
Road Genome: A Topology Reasoning Benchmark for Scene Understanding in Autonomous Driving
By introducing Road Genome (OpenLane-V2), we intend to shift the community's attention and take a step further beyond perception - to the task of topology reasoning for scene structure.
Topology Reasoning for Driving Scenes
Understanding the road genome is essential to realize autonomous driving.
Detection Transformer with Stable Matching
We point out that the unstable matching in DETR is caused by a multi-optimization path problem, which is highlighted by the one-to-one matching design in DETR.
Sparse Dense Fusion for 3D Object Detection
With the prevalence of multimodal learning, camera-LiDAR fusion has gained popularity in 3D object detection.
Geometric-aware Pretraining for Vision-centric 3D Object Detection
We also conduct experiments on various image backbones and view transformations to validate the efficacy of our approach.
3D Data Augmentation for Driving Scenes on Camera
The proposed data augmentation approach contributes to a gain of 1. 7% and 1. 4% in terms of detection accuracy, on Waymo and nuScences respectively.
Lite DETR : An Interleaved Multi-Scale Encoder for Efficient DETR
Recent DEtection TRansformer-based (DETR) models have obtained remarkable performance.
Mimic before Reconstruct: Enhancing Masked Autoencoders with Feature Mimicking
To alleviate this, previous methods simply replace the pixel reconstruction targets of 75% masked tokens by encoded features from pre-trained image-image (DINO) or image-language (CLIP) contrastive learning.
DA-BEV: Depth Aware BEV Transformer for 3D Object Detection
Then, to make the BEV feature more depth-aware, we introduce an auxiliary learning task, called Depth-wise Contrastive Learning (DCL), by sampling positive and negative BEV features along each ray that connects an object and a camera.
Policy Pre-training for Autonomous Driving via Self-supervised Geometric Modeling
Witnessing the impressive achievements of pre-training techniques on large-scale data in the field of computer vision and natural language processing, we wonder whether this idea could be adapted in a grab-and-go spirit, and mitigate the sample inefficiency problem for visuomotor driving.
Distilling Focal Knowledge From Imperfect Expert for 3D Object Detection
Specifically, a set of queries are leveraged to locate the instance-level areas for masked feature generation, to intensify feature representation ability in these areas.
Lite DETR: An Interleaved Multi-Scale Encoder for Efficient DETR
Recent DEtection TRansformer-based (DETR) models have obtained remarkable performance.
Planning-oriented Autonomous Driving
Oriented at this, we revisit the key components within perception and prediction, and prioritize the tasks such that all these tasks contribute to planning.
BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervision
The proposed method is verified with a wide spectrum of traditional and modern image backbones and achieves new SoTA results on the large-scale nuScenes dataset.
Ranked #3 on
3D Object Detection
on nuScenes Camera Only
Stare at What You See: Masked Image Modeling without Reconstruction
However, unlike the low-level features such as pixel values, we argue the features extracted by powerful teacher models already encode rich semantic correlation across regions in an intact image. This raises one question: is reconstruction necessary in Masked Image Modeling (MIM) with a teacher model?
DCL-Net: Deep Correspondence Learning Network for 6D Pose Estimation
Establishment of point correspondence between camera and object coordinate systems is a promising way to solve 6D object poses.
Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipe
As sensor configurations get more complex, integrating multi-source information from different sensors and representing features in a unified view come of vital importance.
ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning
In particular, we propose a spatial-temporal feature learning scheme towards a set of more representative features for perception, prediction and planning tasks simultaneously, which is called ST-P3.
Level 2 Autonomous Driving on a Single Device: Diving into the Devils of Openpilot
Equipped with a wide span of sensors, predominant autonomous driving solutions are becoming more modular-oriented for safe system design.
Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline
The two branches are connected so that the control branch receives corresponding guidance from the trajectory branch at each time step.
Ranked #2 on
Autonomous Driving
on CARLA Leaderboard
HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encoding
One essential task for autonomous driving is to encode the information of a driving scene into vector representations so that the downstream task such as trajectory prediction could perform well.
BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers
In a nutshell, BEVFormer exploits both spatial and temporal information by interacting with spatial and temporal space through predefined grid-shaped BEV queries.
Ranked #6 on
3D Object Detection
on DAIR-V2X-I
PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmark
Methods for 3D lane detection have been recently proposed to address the issue of inaccurate lane layouts in many autonomous driving scenarios (uphill/downhill, bump, etc.).
Ranked #5 on
3D Lane Detection
on Apollo Synthetic 3D Lane
Align Representations With Base: A New Approach to Self-Supervised Learning
Existing symmetric contrastive learning methods suffer from collapses (complete and dimensional) or quadratic complexity of objectives.
Sparse Steerable Convolutions: An Efficient Learning of SE(3)-Equivariant Features for Estimation and Tracking of Object Poses in 3D Space
In this paper, we propose a novel design of Sparse Steerable Convolution (SS-Conv) to address the shortcoming; SS-Conv greatly accelerates steerable convolution with sparse tensors, while strictly preserving the property of SE(3)-equivariance.
Monocular 3D Object Detection: An Extrinsic Parameter Free Approach
Due to the lack of insight in industrial application, existing methods on open datasets neglect the camera pose information, which inevitably results in the detector being susceptible to camera extrinsic parameters.
Ranked #6 on
Monocular 3D Object Detection
on KITTI Cars Moderate
(using extra training data)
Towards Improving the Consistency, Efficiency, and Flexibility of Differentiable Neural Architecture Search
Our method enables differentiable sparsification, and keeps the derived architecture equivalent to that of Engine-cell, which further improves the consistency between search and evaluation.
EnTranNAS: Towards Closing the Gap between the Architectures in Search and Evaluation
The Engine-cell is differentiable for architecture search, while the Transit-cell only transits the current sub-graph by architecture derivation.
Exploring intermediate representation for monocular vehicle pose estimation
The latter question motivates us to incorporate geometry knowledge with a new loss function based on a projective invariant.
Ranked #1 on
Vehicle Pose Estimation
on KITTI
ISTA-NAS: Efficient and Consistent Neural Architecture Search by Sparse Coding
By doing so, our network for search at each update satisfies the sparsity constraint and is efficient to train.
Point-Set Anchors for Object Detection, Instance Segmentation and Pose Estimation
A recent approach for object detection and human pose estimation is to regress bounding boxes or human keypoints from a central point on the object or person.
Dynamical System Inspired Adaptive Time Stepping Controller for Residual Network Families
We establish a stability condition for ResNets with step sizes and weight parameters, and point out the effects of step sizes on the stability and performance.
SOGNet: Scene Overlap Graph Network for Panoptic Segmentation
In order to overcome the lack of supervision, we introduce a differentiable module to resolve the overlap between any pair of instances.
Ranked #8 on
Panoptic Segmentation
on Cityscapes test
Deepsleep: Fast and Accurate Delineation of Sleep Arousals at Millisecond Resolution by Deep Learning
Background: Sleep arousals are transient periods of wakefulness punctuated into sleep.
Finding Task-Relevant Features for Few-Shot Learning by Category Traversal
Few-shot learning is an important area of research.
Feature Intertwiner for Object Detection
We argue that the reliable set could guide the feature learning of the less reliable set during training - in spirit of student mimicking teacher behavior and thus pushing towards a more compact class centroid in the feature space.
Ranked #147 on
Object Detection
on COCO test-dev
Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge
This study assesses the state-of-the-art machine learning (ML) methods used for brain tumor image analysis in mpMRI scans, during the last seven instances of the International Brain Tumor Segmentation (BraTS) challenge, i. e., 2012-2018.
Neural Network Encapsulation
Motivated by the routing to make higher capsule have agreement with lower capsule, we extend the mechanism as a compensation for the rapid loss of information in nearby layers.
Zoom Out-and-In Network with Map Attention Decision for Region Proposal and Object Detection
A key observation is that it is difficult to classify anchors of different sizes with the same set of features.
Ranked #2 on
Region Proposal
on COCO test-dev
Recurrent Scale Approximation for Object Detection in CNN
To further increase efficiency and accuracy, we (a): design a scale-forecast network to globally predict potential scales in the image since there is no need to compute maps on all levels of the pyramid.
Ranked #5 on
Face Detection
on Annotated Faces in the Wild
Learning Deep Features via Congenerous Cosine Loss for Person Recognition
Person recognition aims at recognizing the same identity across time and space with complicated scenes and similar appearance.
Zoom Out-and-In Network with Recursive Training for Object Proposal
In this paper, we propose a zoom-out-and-in network for generating object proposals.
Dual Deep Network for Visual Tracking
In this paper, we propose a dual network to better utilize features among layers for visual tracking.
Multi-Bias Non-linear Activation in Deep Neural Networks
It provides great flexibility of selecting responses to different visual patterns in different magnitude ranges to form rich representations in higher layers.
Learning Deep Representation With Large-Scale Attributes
Experimental results show that the attributes are helpful in learning better features and improving the object detection accuracy by 2. 6% in mAP on the ILSVRC 2014 object detection dataset and 2. 4% in mAP on PASCAL VOC 2007 object detection dataset.
LCNN: Low-level Feature Embedded CNN for Salient Object Detection
In this paper, we propose a novel deep neural network framework embedded with low-level features (LCNN) for salient object detection in complex images.
Inner and Inter Label Propagation: Salient Object Detection in the Wild
For most natural images, some boundary superpixels serve as the background labels and the saliency of other superpixels are determined by ranking their similarities to the boundary labels based on an inner propagation scheme.
