Search Results for author:
Found 32 papers, 10 papers with code
VRP-SAM: SAM with Visual Reference Prompt
In this paper, we propose a novel Visual Reference Prompt (VRP) encoder that empowers the Segment Anything Model (SAM) to utilize annotated reference images as prompts for segmentation, creating the VRP-SAM model.
Spatial Structure Constraints for Weakly Supervised Semantic Segmentation
In this paper, we propose spatial structure constraints (SSC) for weakly supervised semantic segmentation to alleviate the unwanted object over-activation of attention expansion.
Context Disentangling and Prototype Inheriting for Robust Visual Grounding
In this paper, we propose a novel framework with context disentangling and prototype inheriting for robust visual grounding to handle both scenes.
What Large Language Models Bring to Text-rich VQA?
This pipeline achieved superior performance compared to the majority of existing Multimodal Large Language Models (MLLM) on four text-rich VQA datasets.
Learning Contrastive Self-Distillation for Ultra-Fine-Grained Visual Categorization Targeting Limited Samples
In the field of intelligent multimedia analysis, ultra-fine-grained visual categorization (Ultra-FGVC) plays a vital role in distinguishing intricate subcategories within broader categories.
Delving into Multimodal Prompting for Fine-grained Visual Classification
In this paper, we aim to fully exploit the capabilities of cross-modal description to tackle FGVC tasks and propose a novel multimodal prompting solution, denoted as MP-FGVC, based on the contrastive language-image pertaining (CLIP) model.
DiffusionVMR: Diffusion Model for Joint Video Moment Retrieval and Highlight Detection
An arbitrary setting can be used in DiffusionVMR during inference without consistency with the training phase.
Ranked #4 on
Video Grounding
on QVHighlights
M$^3$Net: Multi-view Encoding, Matching, and Fusion for Few-shot Fine-grained Action Recognition
Due to the scarcity of manually annotated data required for fine-grained video understanding, few-shot fine-grained (FS-FG) action recognition has gained significant attention, with the aim of classifying novel fine-grained action categories with only a few labeled instances.
Synthetic Instance Segmentation from Semantic Image Segmentation Masks
SISeg does not require training a semantic or/and instance segmentation model and avoids the need for instance-level image annotations.
The 3rd Anti-UAV Workshop & Challenge: Methods and Results
Second, we set up two tracks for the first time, i. e., Anti-UAV Tracking and Anti-UAV Detection & Tracking.
Exploring Effective Factors for Improving Visual In-Context Learning
By doing this, the model can leverage the diverse knowledge stored in different parts of the model to improve its performance on new tasks.
ADPS: Asymmetric Distillation Post-Segmentation for Image Anomaly Detection
However, existing KDAD methods suffer from two main limitations: 1) the student network can effortlessly replicate the teacher network's representations, and 2) the features of the teacher network serve solely as a ``reference standard" and are not fully leveraged.
Visual Anomaly Detection Via Partition Memory Bank Module and Error Estimation
Reconstruction method based on the memory module for visual anomaly detection attempts to narrow the reconstruction error for normal samples while enlarging it for anomalous samples.
Self-Supervised Guided Segmentation Framework for Unsupervised Anomaly Detection
In this paper, a novel Self-Supervised Guided Segmentation Framework (SGSF) is proposed by jointly exploring effective generation method of forged anomalous samples and the normal sample features as the guidance information of segmentation for anomaly detection.
Entity-enhanced Adaptive Reconstruction Network for Weakly Supervised Referring Expression Grounding
Second, most previous weakly supervised REG methods ignore the discriminative location and context of the referent, causing difficulties in distinguishing the target from other same-category objects.
Singular Value Fine-tuning: Few-shot Segmentation requires Few-parameters Fine-tuning
In this paper, we rethink the paradigm and explore a new regime: {\em fine-tuning a small part of parameters in the backbone}.
Ranked #8 on
Few-Shot Semantic Segmentation
on COCO-20i (1-shot)
sub-region localized hashing for fine-grained image retrieval
Specifically, to localize diverse local regions, a sub-region localization module is developed to learn discriminative local features by locating the peaks of non-overlap sub-regions in the feature map.
SSA: Semantic Structure Aware Inference for Weakly Pixel-Wise Dense Predictions without Cost
The pixel-wise dense prediction tasks based on weakly supervisions currently use Class Attention Maps (CAM) to generate pseudo masks as ground-truth.
Weakly-Supervised Object Localization
Weakly supervised Semantic Segmentation
+1
CTNet: Context-based Tandem Network for Semantic Segmentation
Specifically, the Spatial Contextual Module (SCM) is leveraged to uncover the spatial contextual dependency between pixels by exploring the correlation between pixels and categories.
Ranked #71 on
Semantic Segmentation
on ADE20K val
NuI-Go: Recursive Non-Local Encoder-Decoder Network for Retinal Image Non-Uniform Illumination Removal
We further demonstrate the advantages of the proposed method for improving the accuracy of retinal vessel segmentation.
Data-driven Meta-set Based Fine-Grained Visual Classification
To this end, we propose a data-driven meta-set based approach to deal with noisy web images for fine-grained recognition.
Face Super-Resolution Guided by 3D Facial Priors
State-of-the-art face super-resolution methods employ deep convolutional neural networks to learn a mapping between low- and high- resolution facial patterns by exploring local appearance knowledge.
Deep Semantic Multimodal Hashing Network for Scalable Image-Text and Video-Text Retrievals
In this article, we propose a novel deep semantic multimodal hashing network (DSMHN) for scalable image-text and video-text retrieval.
Single Image Dehazing via Conditional Generative Adversarial Network
In contrast, we solve this problem based on a conditional generative adversarial network (cGAN), where the clear image is estimated by an end-to-end trainable neural network.
Learning Dual Convolutional Neural Networks for Low-Level Vision
These problems usually involve the estimation of two components of the target signals: structures and details.
Deep Ordinal Hashing with Spatial Attention
However, most existing deep hashing methods directly learn the hash functions by encoding the global semantic information, while ignoring the local spatial information of images.
Social Anchor-Unit Graph Regularized Tensor Completion for Large-Scale Image Retagging
Recent approaches simultaneously explore visual, user and tag information to improve the performance of image retagging by constructing and exploring an image-tag-user graph.
Hardware-Efficient Guided Image Filtering For Multi-Label Problem
In this paper we propose a hardware-efficient Guided Filter (HGF), which solves the efficiency problem of multichannel guided image filtering and yields competent results when applying it to multi-label problems with synthesized polynomial multichannel guidance.
Modeling Multimodal Clues in a Hybrid Deep Learning Framework for Video Classification
More specifically, we utilize three Convolutional Neural Networks (CNNs) operating on appearance, motion and audio signals to extract their corresponding features.
Personalized Age Progression with Bi-level Aging Dictionary Learning
Basically, for each age group, we learn an aging dictionary to reveal its aging characteristics (e. g., wrinkles), where the dictionary bases corresponding to the same index yet from two neighboring aging dictionaries form a particular aging pattern cross these two age groups, and a linear combination of all these patterns expresses a particular personalized aging process.
Concurrence-Aware Long Short-Term Sub-Memories for Person-Person Action Recognition
To this end, we propose a novel Concurrence-Aware Long Short-Term Sub-Memories (Co-LSTSM) to model the long-term inter-related dynamics between two interacting people on the bounding boxes covering people.
Ranked #2 on
Human Interaction Recognition
on BIT
Weakly-Supervised Dual Clustering for Image Semantic Segmentation
In this paper, we propose a novel Weakly-Supervised Dual Clustering (WSDC) approach for image semantic segmentation with image-level labels, i. e., collaboratively performing image segmentation and tag alignment with those regions.
