Search Results for author:
Found 36 papers, 28 papers with code
3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting
In this paper, we present an implicit surface reconstruction method with 3D Gaussian Splatting (3DGS), namely 3DGSR, that allows for accurate 3D reconstruction with intricate details while inheriting the high efficiency and rendering quality of 3DGS.
GenNBV: Generalizable Next-Best-View Policy for Active 3D Reconstruction
Previous works attempt to automate this process using the Next-Best-View (NBV) policy for active 3D reconstruction.
Multi-Object Tracking by Hierarchical Visual Representations
We propose a new visual hierarchical representation paradigm for multi-object tracking.
Mixed Gaussian Flow for Diverse Trajectory Prediction
However, mapping from a standard Gaussian by a flow-based model hurts the capacity to capture complicated patterns of trajectories, ignoring the under-represented motion intentions in the training data.
EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI
In the realm of computer vision and robotics, embodied agents are expected to explore their environment and carry out human instructions.
Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Response
Robust locomotion control depends on accurate state estimations.
OV-PARTS: Towards Open-Vocabulary Part Segmentation
Secondly, part segmentation introduces an open granularity challenge due to the diverse and often ambiguous definitions of parts in the open world.
Understanding Masked Autoencoders From a Local Contrastive Perspective
Masked AutoEncoder (MAE) has revolutionized the field of self-supervised learning with its simple yet effective masking and reconstruction strategies.
Unified Human-Scene Interaction via Prompted Chain-of-Contacts
Based on the definition, UniHSI constitutes a Large Language Model (LLM) Planner to translate language prompts into task plans in the form of CoC, and a Unified Controller that turns CoC into uniform task execution.
PointLLM: Empowering Large Language Models to Understand Point Clouds
The unprecedented advancements in Large Language Models (LLMs) have shown a profound impact on natural language processing but are yet to fully embrace the realm of 3D understanding.
Ranked #3 on
3D Question Answering (3D-QA)
on 3D MM-Vet
Transformer-Based Visual Segmentation: A Survey
Recently, transformers, a type of neural network based on self-attention originally designed for natural language processing, have considerably surpassed previous convolutional or recurrent approaches in various vision processing tasks.
DORT: Modeling Dynamic Objects in Recurrent for Multi-Camera 3D Object Detection and Tracking
Recent multi-camera 3D object detectors usually leverage temporal information to construct multi-view stereo that alleviates the ill-posed depth estimation.
Position-Guided Point Cloud Panoptic Segmentation Transformer
DEtection TRansformer (DETR) started a trend that uses a group of learnable queries for unified visual perception.
Ranked #1 on
Panoptic Segmentation
on SemanticKITTI
MV-JAR: Masked Voxel Jigsaw and Reconstruction for LiDAR-Based Self-Supervised Pre-Training
This paper introduces the Masked Voxel Jigsaw and Reconstruction (MV-JAR) method for LiDAR-based self-supervised pre-training and a carefully designed data-efficient 3D object detection benchmark on the Waymo dataset.
Dense Distinct Query for End-to-End Object Detection
Concretely, we first lay dense queries like traditional detectors and then select distinct ones for one-to-one assignments.
Ranked #3 on
Object Detection
on CrowdHuman (full body)
Tube-Link: A Flexible Cross Tube Framework for Universal Video Segmentation
Our framework is a near-online approach that takes a short subclip as input and outputs the corresponding spatial-temporal tube masks.
Ranked #3 on
Video Semantic Segmentation
on VSPW
QDTrack: Quasi-Dense Similarity Learning for Appearance-Only Multiple Object Tracking
In this paper, we present Quasi-Dense Similarity Learning, which densely samples hundreds of object regions on a pair of images for contrastive learning.
Ranked #4 on
Multiple Object Tracking
on BDD100K test
Monocular 3D Object Detection with Depth from Motion
Perceiving 3D objects from monocular inputs is crucial for robotic systems, given its economy compared to multi-sensor settings.
What Are Expected Queries in End-to-End Object Detection?
As both sparse and dense queries are imperfect, then \emph{what are expected queries in end-to-end object detection}?
Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentation
We hope this simple, yet effective method can serve as a new, flexible baseline in unified video segmentation design.
Ranked #1 on
Video Panoptic Segmentation
on KITTI-STEP
(using extra training data)
Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Tracking
Instead of relying only on the linear state estimate (i. e., estimation-centric approach), we use object observations (i. e., the measurements by object detector) to compute a virtual trajectory over the occlusion period to fix the error accumulation of filter parameters during the occlusion period.
Ranked #2 on
Multiple Object Tracking
on KITTI Tracking test
Dense Siamese Network for Dense Unsupervised Learning
It also extracts a batch of region embeddings that correspond to some sub-regions in the overlapped area to be contrasted for region consistency.
Ranked #2 on
Unsupervised Semantic Segmentation
on COCO-All
(mIoU metric)
Towards Balanced Learning for Instance Recognition
In this work, we carefully revisit the standard training practice of detectors, and find that the detection performance is often limited by the imbalance during the training process, which generally consists in three levels - sample level, feature level, and objective level.
Self-Adversarial Disentangling for Specific Domain Adaptation
In this paper, we study a practical setting called Specific Domain Adaptation (SDA) that aligns the source and target domains in a demanded-specific dimension.
Image-to-Image Translation on Cityscapes-to-Foggy Cityscapes
object-detection
+3
Context-Aware Mixup for Domain Adaptive Semantic Segmentation
The generated contextual mask is critical in this work and will guide the context-aware domain mixup on three different levels.
Ranked #5 on
Image-to-Image Translation
on SYNTHIA-to-Cityscapes
Probabilistic and Geometric Depth: Detecting Objects in Perspective
As the preliminary depth estimation of each instance is usually inaccurate in this ill-posed setting, we incorporate a probabilistic representation to capture the uncertainty.
Ranked #10 on
3D Object Detection
on KITTI Cars Hard val
K-Net: Towards Unified Image Segmentation
The framework, named K-Net, segments both instances and semantic categories consistently by a group of learnable kernels, where each kernel is responsible for generating a mask for either a potential instance or a stuff class.
Ranked #7 on
Panoptic Segmentation
on COCO test-dev
FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detection
In this paper, we study this problem with a practice built on a fully convolutional single-stage detector and propose a general framework FCOS3D.
Ranked #323 on
3D Object Detection
on nuScenes
Seesaw Loss for Long-Tailed Instance Segmentation
Instances of head classes dominate a long-tailed dataset and they serve as negative samples of tail categories.
Quasi-Dense Similarity Learning for Multiple Object Tracking
Compared to methods with similar detectors, it boosts almost 10 points of MOTA and significantly decreases the number of ID switches on BDD100K and Waymo datasets.
Ranked #1 on
One-Shot Object Detection
on PASCAL VOC 2012 val
Side-Aware Boundary Localization for More Precise Object Detection
To tackle the difficulty of precise localization in the presence of displacements with large variance, we further propose a two-step localization scheme, which first predicts a range of movement through bucket prediction and then pinpoints the precise position within the predicted bucket.
MMDetection: Open MMLab Detection Toolbox and Benchmark
In this paper, we introduce the various features of this toolbox.
Libra R-CNN: Towards Balanced Learning for Object Detection
In this work, we carefully revisit the standard training practice of detectors, and find that the detection performance is often limited by the imbalance during the training process, which generally consists in three levels - sample level, feature level, and objective level.
Ranked #149 on
Object Detection
on COCO test-dev
R$^2$-CNN: Fast Tiny Object Detection in Large-Scale Remote Sensing Images
To tackle these problems, we propose a unified and self-reinforced network called remote sensing region-based convolutional neural network ($\mathcal{R}^2$-CNN), composing of backbone Tiny-Net, intermediate global attention block, and final classifier and detector.
Hybrid Task Cascade for Instance Segmentation
In exploring a more effective approach, we find that the key to a successful instance segmentation cascade is to fully leverage the reciprocal relationship between detection and segmentation.
Ranked #32 on
Object Detection
on COCO-O
FishNet: A Versatile Backbone for Image, Region, and Pixel Level Prediction
The basic principles in designing convolutional neural network (CNN) structures for predicting objects on different levels, e. g., image-level, region-level, and pixel-level are diverging.
