Search Results for author:
Found 69 papers, 62 papers with code
Point-In-Context: Understanding Point Cloud via In-Context Learning
With the emergence of large-scale models trained on diverse datasets, in-context learning has emerged as a promising paradigm for multitasking, notably in natural language processing and image processing.
VG4D: Vision-Language Model Goes 4D Video Recognition
By transferring the knowledge of the VLM to the 4D encoder and combining the VLM, our VG4D achieves improved recognition performance.
Learning Feature Inversion for Multi-class Anomaly Detection under General-purpose COCO-AD Benchmark
Moreover, current metrics such as AU-ROC have nearly reached saturation on simple datasets, which prevents a comprehensive evaluation of different methods.
DGMamba: Domain Generalization via Generalized State Space Model
SPR strives to encourage the model to concentrate more on objects rather than context, consisting of two designs: Prior-Free Scanning~(PFS), and Domain Context Interchange~(DCI).
MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection
Recent advancements in anomaly detection have seen the efficacy of CNN- and transformer-based approaches.
DVIS-DAQ: Improving Video Segmentation via Dynamic Anchor Queries
Modern video segmentation methods adopt object queries to perform inter-frame association and demonstrate satisfactory performance in tracking continuously appearing objects despite large-scale motion and transient occlusion.
GenView: Enhancing View Quality with Pretrained Generative Model for Self-Supervised Learning
To tackle these challenges, we present GenView, a controllable framework that augments the diversity of positive views leveraging the power of pretrained generative models while preserving semantics.
Explore In-Context Segmentation via Latent Diffusion Models
In-context segmentation has drawn more attention with the introduction of vision foundation models.
Point Cloud Mamba: Point Cloud Learning via State Space Model
To enable more effective processing of 3-D point cloud data by Mamba, we propose a novel Consistent Traverse Serialization to convert point clouds into 1-D point sequences while ensuring that neighboring points in the sequence are also spatially adjacent.
Generalizable Entity Grounding via Assistance of Large Language Model
In this work, we propose a novel approach to densely ground visual entities from a long caption.
Towards Language-Driven Video Inpainting via Multimodal Large Language Models
We introduce a new task -- language-driven video inpainting, which uses natural language instructions to guide the inpainting process.
RAP-SAM: Towards Real-Time All-Purpose Segment Anything
Segment Anything Model (SAM) is one remarkable model that can achieve generalized segmentation.
OMG-Seg: Is One Model Good Enough For All Segmentation?
In this work, we address various segmentation tasks, each traditionally tackled by distinct or partially unified models.
ModelNet-O: A Large-Scale Synthetic Dataset for Occlusion-Aware Point Cloud Classification
Through extensive experiments, we demonstrate that our PointMLS achieves state-of-the-art results on ModelNet-O and competitive results on regular datasets, and it is robust and effective.
Open-Vocabulary SAM: Segment and Recognize Twenty-thousand Classes Interactively
The CLIP and Segment Anything Model (SAM) are remarkable vision foundation models (VFMs).
BA-SAM: Scalable Bias-Mode Attention Mask for Segment Anything Model
To this end, we propose Scalable Bias-Mode Attention Mask (BA-SAM) to enhance SAM's adaptability to varying image resolutions while eliminating the need for structure modifications.
An Open and Comprehensive Pipeline for Unified Object Grounding and Detection
Grounding-DINO is a state-of-the-art open-set detection model that tackles multiple vision tasks including Open-Vocabulary Detection (OVD), Phrase Grounding (PG), and Referring Expression Comprehension (REC).
A Generalist FaceX via Learning Unified Facial Representation
This work presents FaceX framework, a novel facial generalist model capable of handling diverse facial tasks simultaneously.
RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimation
Real-time multi-person pose estimation presents significant challenges in balancing speed and precision.
Ranked #1 on
Multi-Person Pose Estimation
on CrowdPose
(using extra training data)
Exploring Plain ViT Reconstruction for Multi-class Unsupervised Anomaly Detection
Following this spirit, this paper explores plain ViT architecture for MUAD.
EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM
It is also the first SAM variant that can run at over 30 FPS on an iPhone 14.
Skeleton-in-Context: Unified Skeleton Sequence Modeling with In-Context Learning
Under this setting, the model can perceive tasks from prompts and accomplish them without any extra task-specific head predictions or model fine-tuning.
Effective Adapter for Face Recognition in the Wild
Traditional heuristic approaches-either training models directly on these degraded images or their enhanced counterparts using face restoration techniques-have proven ineffective, primarily due to the degradation of facial features and the discrepancy in image domains.
Panoptic Video Scene Graph Generation
PVSG relates to the existing video scene graph generation (VidSGG) problem, which focuses on temporal interactions between humans and objects grounded with bounding boxes in videos.
Rethinking Evaluation Metrics of Open-Vocabulary Segmentaion
We benchmarked the proposed evaluation metrics on 12 open-vocabulary methods of three segmentation tasks.
OV-VG: A Benchmark for Open-Vocabulary Visual Grounding
While current foundational models excel at various visual language tasks, there's a noticeable absence of models specifically tailored for open-vocabulary visual grounding.
DST-Det: Simple Dynamic Self-Training for Open-Vocabulary Object Detection
We refer to this approach as the self-training strategy, which enhances recall and accuracy for novel classes without requiring extra annotations, datasets, and re-training.
CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Prediction
However, when transferring the vision-language alignment of CLIP from global image representation to local region representation for the open-vocabulary dense prediction tasks, CLIP ViTs suffer from the domain shift from full images to local image regions.
MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentation
We present MosaicFusion, a simple yet effective diffusion-based data augmentation approach for large vocabulary instance segmentation.
Neural Collapse Terminus: A Unified Solution for Class Incremental Learning and Its Variants
Beyond the normal case, long-tail class incremental learning and few-shot class incremental learning are also proposed to consider the data imbalance and data scarcity, respectively, which are common in real-world implementations and further exacerbate the well-known problem of catastrophic forgetting.
Iterative Robust Visual Grounding with Masked Reference based Centerpoint Supervision
The proposed framework is evaluated on five regular VG datasets and two newly constructed robust VG datasets.
Pair then Relation: Pair-Net for Panoptic Scene Graph Generation
Panoptic Scene Graph (PSG) is a challenging task in Scene Graph Generation (SGG) that aims to create a more comprehensive scene graph representation using panoptic segmentation instead of boxes.
Towards Open Vocabulary Learning: A Survey
To our knowledge, this is the first comprehensive literature review of open vocabulary learning.
Explore In-Context Learning for 3D Point Cloud Understanding
With the rise of large-scale models trained on broad data, in-context learning has become a new learning paradigm that has demonstrated significant potential in natural language processing and computer vision tasks.
Change Detection Methods for Remote Sensing in the Last Decade: A Comprehensive Review
We first introduce some preliminary knowledge for the change detection task, such as problem definition, datasets, evaluation metrics, and transformer basics, as well as provide a detailed taxonomy of existing algorithms from three different perspectives: algorithm granularity, supervision modes, and learning frameworks in the methodology section.
Transformer-Based Visual Segmentation: A Survey
Recently, transformers, a type of neural network based on self-attention originally designed for natural language processing, have considerably surpassed previous convolutional or recurrent approaches in various vision processing tasks.
Tube-Link: A Flexible Cross Tube Framework for Universal Video Segmentation
Our framework is a near-online approach that takes a short subclip as input and outputs the corresponding spatial-temporal tube masks.
Ranked #3 on
Video Semantic Segmentation
on VSPW
Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learning
In this paper, we deal with this misalignment dilemma in FSCIL inspired by the recently discovered phenomenon named neural collapse, which reveals that the last-layer features of the same class will collapse into a vertex, and the vertices of all classes are aligned with the classifier prototypes, which are formed as a simplex equiangular tight frame (ETF).
Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class-Incremental Learning
In this paper, we deal with this misalignment dilemma in FSCIL inspired by the recently discovered phenomenon named neural collapse, which reveals that the last-layer features of the same class will collapse into a vertex, and the vertices of all classes are aligned with the classifier prototypes, which are formed as a simplex equiangular tight frame (ETF).
Ranked #3 on
Few-Shot Class-Incremental Learning
on CUB-200-2011
Reference Twice: A Simple and Unified Baseline for Few-Shot Instance Segmentation
In this work, we explore a simple yet unified solution for FSIS as well as its incremental variants, and introduce a new framework named Reference Twice (RefT) to fully explore the relationship between support/query features based on a Transformer-like framework.
PanopticPartFormer++: A Unified and Decoupled View for Panoptic Part Segmentation
Third, inspired by Mask2Former, based on our meta-architecture, we propose Panoptic-PartFormer++ and design a new part-whole cross-attention scheme to boost part segmentation qualities further.
Rethinking Mobile Block for Efficient Attention-based Models
This paper focuses on developing modern, efficient, lightweight models for dense predictions while trading off parameters, FLOPs, and performance.
Betrayed by Captions: Joint Caption Grounding and Generation for Open Vocabulary Instance Segmentation
Experiments on the COCO dataset with two settings: Open Vocabulary Instance Segmentation (OVIS) and Open Set Panoptic Segmentation (OSPS) demonstrate the superiority of the CGG.
Convolution-enhanced Evolving Attention Networks
To the best of our knowledge, this is the first work that explicitly models the layer-wise evolution of attention maps.
Towards Robust Referring Image Segmentation
It considers the negative sentence inputs besides the regular positive text inputs.
SFNet: Faster, Accurate, and Domain Agnostic Semantic Segmentation via Semantic Flow
In this paper, we focus on exploring effective methods for faster, accurate, and domain agnostic semantic segmentation.
EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm
Motivated by biological evolution, this paper explains the rationality of Vision Transformer by analogy with the proven practical Evolutionary Algorithm (EA) and derives that both have consistent mathematical formulation.
Multi-Task Learning with Multi-Query Transformer for Dense Prediction
We first model each task with a task-relevant query.
Fashionformer: A simple, Effective and Unified Baseline for Human Fashion Segmentation and Recognition
This focus on joint human fashion segmentation and attribute recognition.
Panoptic-PartFormer: Learning a Unified Model for Panoptic Part Segmentation
To the best of our knowledge, we are the first to solve the PPS problem via \textit{a unified and end-to-end transformer model.
Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentation
We hope this simple, yet effective method can serve as a new, flexible baseline in unified video segmentation design.
Ranked #1 on
Video Panoptic Segmentation
on KITTI-STEP
(using extra training data)
Inducing Neural Collapse in Imbalanced Learning: Do We Really Need a Learnable Classifier at the End of Deep Neural Network?
Modern deep neural networks for classification usually jointly learn a backbone for representation and a linear classifier to output the logit of each class.
Ranked #26 on
Long-tail Learning
on CIFAR-10-LT (ρ=100)
TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformers
Detection Transformer (DETR) and Deformable DETR have been proposed to eliminate the need for many hand-designed components in object detection while demonstrating good performance as previous complex hand-crafted detectors.
Ranked #4 on
Video Object Detection
on ImageNet VID
(using extra training data)
PolyphonicFormer: Unified Query Learning for Depth-aware Video Panoptic Segmentation
The Depth-aware Video Panoptic Segmentation (DVPS) is a new challenging vision problem that aims to predict panoptic segmentation and depth in a video simultaneously.
Improving Video Instance Segmentation via Temporal Pyramid Routing
To incorporate both temporal and scale information, we propose a Temporal Pyramid Routing (TPR) strategy to conditionally align and conduct pixel-level aggregation from a feature pyramid pair of two adjacent frames.
Global Aggregation then Local Distribution for Scene Parsing
Modelling long-range contextual relationships is critical for pixel-wise prediction tasks such as semantic segmentation.
BoundarySqueeze: Image Segmentation as Boundary Squeezing
This module is used to squeeze the object boundary from both inner and outer directions, which contributes to precise mask representation.
Fast and Accurate Scene Parsing via Bi-direction Alignment Networks
Motivated by this, we propose a novel network by aligning two-path information into each other through a learned flow field.
Dynamic Dual Sampling Module for Fine-Grained Semantic Segmentation
Representation of semantic context and local details is the essential issue for building modern semantic segmentation models.
End-to-End Video Object Detection with Spatial-Temporal Transformers
Recently, DETR and Deformable DETR have been proposed to eliminate the need for many hand-designed components in object detection while demonstrating good performance as previous complex hand-crafted detectors.
Enhanced Boundary Learning for Glass-like Object Segmentation
We use these two modules to design a decoder that generates accurate and clean segmentation results, especially on the object contours.
Ranked #20 on
Thermal Image Segmentation
on RGB-T-Glass-Segmentation
PointFlow: Flowing Semantics Through Points for Aerial Image Segmentation
Experimental results on three different aerial segmentation datasets suggest that the proposed method is more effective and efficient than state-of-the-art general semantic segmentation methods.
Involution: Inverting the Inherence of Convolution for Visual Recognition
Convolution has been the core ingredient of modern neural networks, triggering the surge of deep learning in vision.
Ranked #703 on
Image Classification
on ImageNet
Towards Efficient Scene Understanding via Squeeze Reasoning
Instead of propagating information on the spatial map, we first learn to squeeze the input feature into a channel-wise global vector and perform reasoning within the single vector where the computation cost can be significantly reduced.
Improving Semantic Segmentation via Decoupled Body and Edge Supervision
Our insight is that appealing performance of semantic segmentation requires \textit{explicitly} modeling the object \textit{body} and \textit{edge}, which correspond to the high and low frequency of the image.
Semantic Flow for Fast and Accurate Scene Parsing
A common practice to improve the performance is to attain high resolution feature maps with strong semantic representation.
Ranked #2 on
Real-Time Semantic Segmentation
on Cityscapes test
Global Aggregation then Local Distribution in Fully Convolutional Networks
GALD is end-to-end trainable and can be easily plugged into existing FCNs with various global aggregation modules for a wide range of vision tasks, and consistently improves the performance of state-of-the-art object detection and instance segmentation approaches.
Ranked #1 on
Semantic Segmentation
on PASCAL VOC 2007
Dual Graph Convolutional Network for Semantic Segmentation
Exploiting long-range contextual information is key for pixel-wise prediction tasks such as semantic segmentation.
Ranked #32 on
Semantic Segmentation
on Cityscapes test
GFF: Gated Fully Fusion for Semantic Segmentation
Semantic segmentation generates comprehensive understanding of scenes through densely predicting the category for each pixel.
Ranked #29 on
Semantic Segmentation
on Cityscapes test
