Search Results for author:
Found 70 papers, 46 papers with code
DFIMat: Decoupled Flexible Interactive Matting in Multi-Person Scenarios
(2) Existing works are limited to a single type of user input, which is ineffective for intention understanding and also inefficient for user operation.
Replace Anyone in Videos
Recent advancements in controllable human-centric video generation, particularly with the rise of diffusion models, have demonstrated considerable progress.
Cross-video Identity Correlating for Person Re-identification Pre-training
For example, compared with the previous state-of-the-art~\cite{ISR}, CION with the same ResNet50-IBN achieves higher mAP of 93. 3\% and 74. 3\% on Market1501 and MSMT17, while only utilizing 8\% training samples.
Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLM
We train a lightweight temporal sampler to select frames with high anomaly response and fine-tune a multimodal large language model (LLM) to generate explanatory content.
Open-Vocabulary Semantic Segmentation with Image Embedding Balancing
To learn a consistent semantic structure from CLIP, the SSC Loss aligns the inter-classes affinity in the image feature space with that in the text feature space of CLIP, thereby improving the generalization ability of our model.
UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation
First, to reduce the optimization difficulty and ensure temporal coherence, we map the reference image along with the posture guidance and noise video into a common feature space by incorporating a unified video diffusion model.
Tunnel Try-on: Excavating Spatial-temporal Tunnels for High-quality Virtual Try-on in Videos
To generate coherent motions, we first leverage the Kalman filter to construct smooth crops in the focus tunnel and inject the position embedding of the tunnel into attention layers to improve the continuity of the generated videos.
REPAIR: Rank Correlation and Noisy Pair Half-replacing with Memory for Noisy Correspondence
Unfortunately, obtaining precise annotations in the multimodal field is expensive, which has prompted some methods to tackle the mismatched data pair issue in cross-modal matching contexts, termed as noisy correspondence.
GlanceVAD: Exploring Glance Supervision for Label-efficient Video Anomaly Detection
In recent years, video anomaly detection has been extensively investigated in both unsupervised and weakly supervised settings to alleviate costly temporal labeling.
Spatial Cascaded Clustering and Weighted Memory for Unsupervised Person Re-identification
We introduce the Spatial Cascaded Clustering and Weighted Memory (SCWM) method to address these challenges.
Few-Shot Learning for Annotation-Efficient Nucleus Instance Segmentation
In this paper, we propose to formulate annotation-efficient nucleus instance segmentation from the perspective of few-shot learning (FSL).
VS: Reconstructing Clothed 3D Human from Single Image via Vertex Shift
However current implicit function-based methods inevitably produce artifacts while existing deformation methods are difficult to reconstruct high-fidelity humans wearing loose clothing.
SCTNet: Single-Branch CNN with Transformer Semantic Information for Real-Time Segmentation
Recent real-time semantic segmentation methods usually adopt an additional semantic branch to pursue rich long-range context.
A Recipe for Scaling up Text-to-Video Generation with Text-free Videos
Following such a pipeline, we study the effect of doubling the scale of training set (i. e., video-only WebVid10M) with some randomly collected text-free videos and are encouraged to observe the performance improvement (FID from 9. 67 to 8. 19 and FVD from 484 to 441), demonstrating the scalability of our approach.
Ranked #7 on
Text-to-Video Generation
on MSR-VTT
VideoLCM: Video Latent Consistency Model
Consistency models have demonstrated powerful capability in efficient image generation and allowed synthesis within a few sampling steps, alleviating the high computational cost in diffusion models.
Hierarchical Spatio-temporal Decoupling for Text-to-Video Generation
At the structure level, we decompose the T2V task into two steps, including spatial reasoning and temporal reasoning, using a unified denoiser.
Ranked #6 on
Text-to-Video Generation
on MSR-VTT
UFineBench: Towards Text-based Person Retrieval with Ultra-fine Granularity
Firstly, we construct a new \textbf{dataset} named UFine6926.
Lookup Table meets Local Laplacian Filter: Pyramid Reconstruction Network for Tone Mapping
Furthermore, we utilize local Laplacian filters to refine the edge details in the high-frequency components in an adaptive manner.
Few-shot Action Recognition with Captioning Foundation Models
In this paper, we develop an effective plug-and-play framework called CapFSAR to exploit the knowledge of multimodal models without manually annotating text.
Disentangling Spatial and Temporal Learning for Efficient Image-to-Video Transfer Learning
When pre-training on the large-scale Kinetics-710, we achieve 89. 7% on Kinetics-400 with a frozen ViT-L model, which verifies the scalability of DiST.
HR-Pro: Point-supervised Temporal Action Localization via Hierarchical Reliability Propagation
For snippet-level learning, we introduce an online-updated memory to store reliable snippet prototypes for each class.
Ranked #1 on
Weakly Supervised Action Localization
on BEOID
Adaptive Semantic Consistency for Cross-domain Few-shot Classification
In this way, the proposed ASC enables explicit transfer of source domain knowledge to prevent the model from overfitting the target domain.
Towards General Low-Light Raw Noise Synthesis and Modeling
To address this issue, we introduce a new perspective to synthesize the signal-independent noise by a generative model.
Ranked #2 on
Image Denoising
on SID SonyA7S2 x300
Conditional Boundary Loss for Semantic Segmentation
We conduct extensive experiments on ADE20K, Cityscapes, and Pascal Context, and the results show that applying the CBL to various popular segmentation networks can significantly improve the mIoU and boundary F-score performance.
Ranked #23 on
Semantic Segmentation
on Cityscapes val
PLIP: Language-Image Pre-training for Person Representation Learning
To address this issue, we propose a novel language-image pre-training framework for person representation learning, termed PLIP.
Ranked #7 on
Text based Person Retrieval
on ICFG-PEDES
MoLo: Motion-augmented Long-short Contrastive Learning for Few-shot Action Recognition
To address these issues, we develop a Motion-augmented Long-short Contrastive Learning (MoLo) method that contains two crucial components, including a long-short contrastive objective and a motion autodecoder.
CLIP-guided Prototype Modulating for Few-shot Action Recognition
Learning from large-scale contrastive language-image pre-training like CLIP has shown remarkable success in a wide range of downstream tasks recently, but it is still under-explored on the challenging few-shot action recognition (FSAR) task.
Semantic Segmentation via Pixel-to-Center Similarity Calculation
Under this novel view, we propose a Class Center Similarity layer (CCS layer) to address the above-mentioned challenges by generating adaptive class centers conditioned on different scenes and supervising the similarities between class centers.
HyRSM++: Hybrid Relation Guided Temporal Set Matching for Few-shot Action Recognition
To be specific, HyRSM++ consists of two key components, a hybrid relation module and a temporal set matching metric.
Parallel Reasoning Network for Human-Object Interaction Detection
Human-Object Interaction (HOI) detection aims to learn how human interacts with surrounding objects.
DMRNet++: Learning Discriminative Features with Decoupled Networks and Enriched Pairs for One-Step Person Search
Person search aims at localizing and recognizing query persons from raw video frames, which is a combination of two sub-tasks, i. e., pedestrian detection and person re-identification.
Ranked #3 on
Person Search
on PRW
Cross Attention Based Style Distribution for Controllable Person Image Synthesis
In this paper, we propose a cross attention based style distribution module that computes between the source semantic styles and target pose for pose transfer.
MAR: Masked Autoencoders for Efficient Action Recognition
Inspired by this, we propose propose Masked Action Recognition (MAR), which reduces the redundant computation by discarding a proportion of patches and operating only on a part of the videos.
Ranked #11 on
Action Recognition
on Something-Something V2
Context-aware Proposal Network for Temporal Action Detection
This technical report presents our first place winning solution for temporal action detection task in CVPR-2022 AcitivityNet Challenge.
Hybrid Relation Guided Set Matching for Few-shot Action Recognition
To overcome the two limitations, we propose a novel Hybrid Relation guided Set Matching (HyRSM) approach that incorporates two key components: hybrid relation module and set matching metric.
Learning from Untrimmed Videos: Self-Supervised Video Representation Learning with Hierarchical Consistency
In this work, we aim to learn representations by leveraging more abundant information in untrimmed videos.
Style Transformer for Image Inversion and Editing
Existing GAN inversion methods fail to provide latent codes for reliable reconstruction and flexible editing simultaneously.
Multi-Centroid Representation Network for Domain Adaptive Person Re-ID
First, we present a Domain-Specific Contrastive Learning (DSCL) mechanism to fully explore intradomain information by comparing samples only from the same domain.
Contrastive Learning
Domain Adaptive Person Re-Identification
+2
Modality-Aware Triplet Hard Mining for Zero-shot Sketch-Based Image Retrieval
By combining two fundamental learning approaches in DML, e. g., classification training and pairwise training, we set up a strong baseline for ZS-SBIR.
Unsupervised Low-Light Image Enhancement via Histogram Equalization Prior
We introduce a Noise Disentanglement Module (NDM) to disentangle the noise and content in the reflectance maps with the reliable aid of unpaired clean images.
Ranked #2 on
Low-Light Image Enhancement
on MEF
Attribute-specific Control Units in StyleGAN for Fine-grained Image Manipulation
Image manipulation with StyleGAN has been an increasing concern in recent years. Recent works have achieved tremendous success in analyzing several semantic latent spaces to edit the attributes of the generated images. However, due to the limited semantic and spatial manipulation precision in these latent spaces, the existing endeavors are defeated in fine-grained StyleGAN image manipulation, i. e., local attribute translation. To address this issue, we discover attribute-specific control units, which consist of multiple channels of feature maps and modulation styles.
CondNet: Conditional Classifier for Scene Segmentation
The last layer of FCN is typically a global classifier (1x1 convolution) to recognize each pixel to a semantic label.
Ranked #18 on
Semantic Segmentation
on PASCAL Context
Weakly Supervised Person Search with Region Siamese Networks
Large-scale labeled training data is often difficult to collect, especially for person identities.
ParamCrop: Parametric Cubic Cropping for Video Contrastive Learning
The visualizations show that ParamCrop adaptively controls the center distance and the IoU between two augmented views, and the learned change in the disparity along the training process is beneficial to learning a strong representation.
Exploring Stronger Feature for Temporal Action Localization
Temporal action localization aims to localize starting and ending time with action category.
OadTR: Online Action Detection with Transformers
Most recent approaches for online action detection tend to apply Recurrent Neural Network (RNN) to capture long-range temporal structure.
Ranked #8 on
Online Action Detection
on THUMOS'14
Proposal Relation Network for Temporal Action Detection
We calculate the detection results by assigning the proposals with corresponding classification results.
Ranked #3 on
Temporal Action Localization
on ActivityNet-1.3
(using extra training data)
A Stronger Baseline for Ego-Centric Action Detection
This technical report analyzes an egocentric video action detection method we used in the 2021 EPIC-KITCHENS-100 competition hosted in CVPR2021 Workshop.
Lite-HRNet: A Lightweight High-Resolution Network
We introduce a lightweight unit, conditional channel weighting, to replace costly pointwise (1x1) convolutions in shuffle blocks.
Ranked #33 on
Pose Estimation
on COCO test-dev
(using extra training data)
Self-Supervised Learning for Semi-Supervised Temporal Action Proposal
In this paper, we focus on applying the power of self-supervised methods to improve semi-supervised action proposal generation.
Ranked #2 on
Semi-Supervised Action Detection
on ActivityNet-1.3
Temporal Context Aggregation Network for Temporal Action Proposal Refinement
In this paper, we propose Temporal Context Aggregation Network (TCANet) to generate high-quality action proposals through "local and global" temporal context aggregation and complementary as well as progressive boundary refinement.
Ranked #10 on
Temporal Action Localization
on ActivityNet-1.3
Decoupled and Memory-Reinforced Networks: Towards Effective Feature Learning for One-Step Person Search
Specifically, to reconcile the conflicts of multiple objectives, we simplify the standard tightly coupled pipelines and establish a deeply decoupled multi-task learning framework.
Ranked #8 on
Person Search
on PRW
Weakly Supervised Text-Based Person Re-Identification
Specifically, to alleviate the intra-class variations, a clustering method is utilized to generate pseudo labels for both visual and textual instances.
Do Not Disturb Me: Person Re-identification Under the Interference of Other Pedestrians
In the conventional person Re-ID setting, it is widely assumed that cropped person images are for each individual.
Representative Graph Neural Network
In this paper, we present a Representative Graph (RepGraph) layer to dynamically sample a few representative features, which dramatically reduces redundancy.
Multi-Level Temporal Pyramid Network for Action Detection
By this means, the proposed MLTPN can learn rich and discriminative features for different action instances with different durations.
Adversarial Semantic Data Augmentation for Human Pose Estimation
Human pose estimation is the task of localizing body keypoints from still images.
CBR-Net: Cascade Boundary Refinement Network for Action Detection: Submission to ActivityNet Challenge 2020 (Task 1)
In this report, we present our solution for the task of temporal action localization (detection) (task 1) in ActivityNet Challenge 2020.
Temporal Fusion Network for Temporal Action Localization:Submission to ActivityNet Challenge 2020 (Task E)
This technical report analyzes a temporal action localization method we used in the HACS competition which is hosted in Activitynet Challenge 2020. The goal of our task is to locate the start time and end time of the action in the untrimmed video, and predict action category. Firstly, we utilize the video-level feature information to train multiple video-level action classification models.
Relevant Region Prediction for Crowd Counting
The module builds a fully connected directed graph between the regions of different density where each node (region) is represented by weighted global pooled feature, and GCN is learned to map this region graph to a set of relation-aware regions representations.
Domain Adaptation for Image Dehazing
By training image translation and dehazing network in an end-to-end manner, we can obtain better effects of both image translation and dehazing.
Ranked #5 on
Image Dehazing
on RESIDE-6K
BiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentation
We propose to treat these spatial details and categorical semantics separately to achieve high accuracy and high efficiency for realtime semantic segmentation.
Ranked #1 on
Real-Time Semantic Segmentation
on COCO-Stuff
Context Prior for Scene Segmentation
Given an input image and corresponding ground truth, Affinity Loss constructs an ideal affinity map to supervise the learning of Context Prior.
Ranked #1 on
Scene Understanding
on ADE20K val
FGN: Fully Guided Network for Few-Shot Instance Segmentation
Few-shot instance segmentation (FSIS) conjoins the few-shot learning paradigm with general instance segmentation, which provides a possible way of tackling instance segmentation in the lack of abundant labeled data for training.
GTNet: Generative Transfer Network for Zero-Shot Object Detection
FFU and BFU add the IoU variance to the results of CFU, yielding class-specific foreground and background features, respectively.
Re-ID Driven Localization Refinement for Person Search
The state-of-the-art methods train the detector individually, and the detected bounding boxes may be sub-optimal for the following re-ID task.
BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation
Semantic segmentation requires both rich spatial information and sizeable receptive field.
Ranked #4 on
Semantic Segmentation
on SkyScapes-Dense
Dichotomous Image Segmentation
Real-Time Semantic Segmentation
+2
Learning a Discriminative Feature Network for Semantic Segmentation
Most existing methods of semantic segmentation still suffer from two aspects of challenges: intra-class inconsistency and inter-class indistinction.
Ranked #5 on
Semantic Segmentation
on PASCAL VOC 2012 test
Learning a Discriminative Prior for Blind Image Deblurring
We present an effective blind image deblurring method based on a data-driven discriminative prior. Our work is motivated by the fact that a good image prior should favor clear images over blurred images. In this work, we formulate the image prior as a binary classifier which can be achieved by a deep convolutional neural network (CNN). The learned prior is able to distinguish whether an input image is clear or not. Embedded into the maximum a posterior (MAP) framework, it helps blind deblurring in various scenarios, including natural, face, text, and low-illumination images. However, it is difficult to optimize the deblurring method with the learned image prior as it involves a non-linear CNN. Therefore, we develop an efficient numerical approach based on the half-quadratic splitting method and gradient decent algorithm to solve the proposed model. Furthermore, the proposed model can be easily extended to non-uniform deblurring. Both qualitative and quantitative experimental results show that our method performs favorably against state-of-the-art algorithms as well as domain-specific image deblurring approaches.
Exemplar-based Linear Discriminant Analysis for Robust Object Tracking
However, the task in tracking is to search for a specific object, rather than an object category as in detection.
