Search Results for author:
Found 44 papers, 28 papers with code
Dynamic Correlation Learning and Regularization for Multi-Label Confidence Calibration
To overcome these limitations, we propose the Dynamic Correlation Learning and Regularization (DCLR) algorithm, which leverages multi-grained semantic correlations to better model semantic confusion for adaptive regularization.
Diff-Mosaic: Augmenting Realistic Representations in Infrared Small Target Detection via Diffusion Prior
Large-scale trained diffusion models have a strong generative prior that enables real-world modeling of images to generate diverse and realistic images.
Adaptive Global-Local Representation Learning and Selection for Cross-Domain Facial Expression Recognition
Specifically, the framework consists of separate global-local adversarial learning modules that learn domain-invariant global and local features independently.
Cross-Domain Facial Expression Recognition
Model Optimization
+2
Learning Adaptive Spatial Coherent Correlations for Speech-Preserving Facial Expression Manipulation
To capitalize on this insight we propose a novel adaptive spatial coherent correlation learning (ASCCL) algorithm which models the aforementioned correlation as an explicit metric and integrates the metric to supervise manipulating facial expression and meanwhile better preserving the facial animation of spoken contents.
Mimic: Speaking Style Disentanglement for Speech-Driven 3D Facial Animation
Moreover, to facilitate disentangled representation learning, we introduce four well-designed constraints: an auxiliary style classifier, an auxiliary inverse classifier, a content contrastive loss, and a pair of latent cycle losses, which can effectively contribute to the construction of the identity-related style space and semantic-related content space.
MotionCtrl: A Unified and Flexible Motion Controller for Video Generation
Motions in a video primarily consist of camera motion, induced by camera movement, and object motion, resulting from object movement.
SQLNet: Scale-Modulated Query and Localization Network for Few-Shot Class-Agnostic Counting
In the localization stage, the Scale-aware Multi-head Localization (SAML) module utilizes the query tensor to predict the confidence, location, and size of each potential object.
Contrastive Transformer Learning with Proximity Data Generation for Text-Based Person Search
Moreover, we propose a proximity data generation (PDG) module to automatically produce more diverse data for cross-modal training.
Spatial-Temporal Knowledge-Embedded Transformer for Video Scene Graph Generation
In this work, we propose a spatial-temporal knowledge-embedded transformer (STKET) that incorporates the prior spatial-temporal knowledge into the multi-head cross-attention mechanism to learn more representative relationship representations.
Towards CausalGPT: A Multi-Agent Approach for Faithful Knowledge Reasoning via Promoting Causal Consistency in LLMs
Despite advancements in LLMs, knowledge-based reasoning remains a longstanding issue due to the fragility of knowledge recall and inference.
RestoreFormer++: Towards Real-World Blind Face Restoration from Undegraded Key-Value Pairs
In this work, we propose RestoreFormer++, which on the one hand introduces fully-spatial attention mechanisms to model the contextual information and the interplay with the priors, and on the other hand, explores an extending degrading model to help generate more realistic degraded face images to alleviate the synthetic-to-real-world gap.
Perception and Semantic Aware Regularization for Sequential Confidence Calibration
In this work, we find tokens/sequences with high perception and semantic correlations with the target ones contain more correlated and effective information and thus facilitate more effective regularization.
Open-World Pose Transfer via Sequential Test-Time Adaption
In open-world conditions, the pose transfer task raises various independent signals: OOD appearance and skeleton, which need to be extracted and distributed in speciality.
OccluMix: Towards De-Occlusion Virtual Try-on by Semantically-Guided Mixup
Image Virtual try-on aims at replacing the cloth on a personal image with a garment image (in-shop clothes), which has attracted increasing attention from the multimedia and computer vision communities.
Category-Adaptive Label Discovery and Noise Rejection for Multi-label Image Recognition with Partial Positive Labels
To reject noisy labels, recent works regard large loss samples as noise but ignore the semantic correlation different multi-label images.
Dual-Perspective Semantic-Aware Representation Blending for Multi-Label Image Recognition with Partial Labels
Specifically, an instance-perspective representation blending (IPRB) module is designed to blend the representations of the known labels in an image with the representations of the corresponding unknown labels in another image to complement these unknown labels.
Multi-Label Image Recognition
Multi-label Image Recognition with Partial Labels
Heterogeneous Semantic Transfer for Multi-label Recognition with Partial Labels
Multi-label image recognition with partial labels (MLR-PL), in which some labels are known while others are unknown for each image, may greatly reduce the cost of annotation and thus facilitate large-scale MLR.
Multi-Label Image Recognition
Multi-label Image Recognition with Partial Labels
Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image Translation
Recently, contrastive learning (CL) has been used to further investigate the image correspondence in unpaired image translation by using patch-based positive/negative learning.
Semantic Representation and Dependency Learning for Multi-Label Image Recognition
We also design an object erasing (OE) module to implicitly learn semantic dependency among categories by erasing semantic-aware regions to regularize the network training.
Semantic-Aware Representation Blending for Multi-Label Image Recognition with Partial Labels
However, these algorithms depend on sufficient multi-label annotations to train the models, leading to poor performance especially with low known label proportion.
Multi-Label Image Recognition
Multi-label Image Recognition with Partial Labels
Structured Semantic Transfer for Multi-Label Recognition with Partial Labels
To reduce the annotation cost, we propose a structured semantic transfer (SST) framework that enables training multi-label recognition models with partial labels, i. e., merely some labels are known while other labels are missing (also called unknown labels) per image.
Multi-Label Image Recognition
Multi-label Image Recognition with Partial Labels
Aerial Images Meet Crowdsourced Trajectories: A New Approach to Robust Road Extraction
Land remote sensing analysis is a crucial research in earth science.
Ranked #2 on
Semantic Segmentation
on BJRoad
AU-Expression Knowledge Constrained Representation Learning for Facial Expression Recognition
In this work, we explore the correlations among the action units and facial expressions, and devise an AU-Expression Knowledge Constrained Representation Learning (AUE-CRL) framework to learn the AU representations without AU annotations and adaptively use representations to facilitate facial expression recognition.
Facial Expression Recognition
Facial Expression Recognition (FER)
+1
Knowledge-Guided Multi-Label Few-Shot Learning for General Image Recognition
The framework exploits prior knowledge to guide adaptive information propagation among different categories to facilitate multi-label analysis and reduce the dependency of training samples.
Adversarial Graph Representation Adaptation for Cross-Domain Facial Expression Recognition
However, most of these works focus on holistic feature adaptation, and they ignore local features that are more transferable across different datasets.
Cross-Domain Facial Expression Recognition
Facial Expression Recognition (FER)
Cross-Domain Facial Expression Recognition: A Unified Evaluation Benchmark and Adversarial Graph Learning
Although each declares to achieve superior performance, fair comparisons are lacking due to the inconsistent choices of the source/target datasets and feature extractors.
Ranked #1 on
Cross-Domain Facial Expression Recognition
on Source: AFE, Target: CK+, JAFFE, SFEW2.0, FER2013, ExpW
Cross-Domain Facial Expression Recognition
Domain Adaptation
+3
Fine-Grained Image Captioning with Global-Local Discriminative Objective
This is primarily due to (i) the conservative characteristic of traditional training objectives that drives the model to generate correct but hardly discriminative captions for similar images and (ii) the uneven word distribution of the ground-truth captions, which encourages generating highly frequent words/phrases while suppressing the less frequent but more concrete ones.
Efficient Crowd Counting via Structured Knowledge Transfer
Crowd counting is an application-oriented task and its inference efficiency is crucial for real-world applications.
Knowledge Graph Transfer Network for Few-Shot Recognition
In this work, we represent the semantic correlations in the form of structured knowledge graph and integrate this graph into deep neural networks to promote few-shot learning by a novel Knowledge Graph Transfer Network (KGTN).
Learning Semantic-Specific Graph Representation for Multi-Label Image Recognition
Recognizing multiple labels of images is a practical and challenging task, and significant progress has been made by searching semantic-aware regions and modeling label dependency.
Ranked #9 on
Multi-Label Classification
on PASCAL VOC 2007
Semi-Supervised Video Salient Object Detection Using Pseudo-Labels
Specifically, we present an effective video saliency detector that consists of a spatial refinement network and a spatiotemporal module.
Ranked #1 on
Video Salient Object Detection
on VOS-T
(using extra training data)
Knowledge-Embedded Routing Network for Scene Graph Generation
More specifically, we show that the statistical correlations between objects appearing in images and their relationships, can be explicitly represented by a structured knowledge graph, and a routing mechanism is learned to propagate messages through the graph to explore their interactions.
Ranked #9 on
Scene Graph Generation
on Visual Genome
Neural Task Planning with And-Or Graph Representations
This paper focuses on semantic task planning, i. e., predicting a sequence of actions toward accomplishing a specific task under a certain scene, which is a new problem in computer vision research.
Fine-Grained Representation Learning and Recognition by Exploiting Hierarchical Semantic Embedding
In this work, we investigate simultaneously predicting categories of different levels in the hierarchy and integrating this structured correlation information into the deep neural network by developing a novel Hierarchical Semantic Embedding (HSE) framework.
Ranked #54 on
Fine-Grained Image Classification
on CUB-200-2011
Fine-Grained Image Classification
Fine-Grained Image Recognition
+1
Knowledge-Embedded Representation Learning for Fine-Grained Image Recognition
Humans can naturally understand an image in depth with the aid of rich knowledge accumulated from daily lives or professions.
Fine-Grained Image Classification
Fine-Grained Image Recognition
+2
Deep Reasoning with Knowledge Graph for Social Relationship Understanding
And this structured knowledge can be efficiently integrated into the deep neural network architecture to promote social relationship understanding by an end-to-end trainable Graph Reasoning Model (GRM), in which a propagation mechanism is learned to propagate node message through the graph to explore the interaction between persons of interest and the contextual objects.
Ranked #2 on
Visual Social Relationship Recognition
on PIPA
Learning a Wavelet-like Auto-Encoder to Accelerate Deep Neural Networks
In this work, aiming at a general and comprehensive way for neural network acceleration, we develop a Wavelet-like Auto-Encoder (WAE) that decomposes the original input image into two low-resolution channels (sub-images) and incorporate the WAE into the classification neural networks for joint training.
Recurrent Attentional Reinforcement Learning for Multi-label Image Recognition
Recognizing multiple labels of images is a fundamental but challenging task in computer vision, and remarkable progress has been attained by localizing semantic-aware image regions and predicting their labels with deep convolutional neural networks.
Multi-label Image Recognition by Recurrently Discovering Attentional Regions
This paper proposes a novel deep architecture to address multi-label image recognition, a fundamental and practical task towards general visual understanding.
Content-Adaptive Sketch Portrait Generation by Decompositional Representation Learning
Sketch portrait generation benefits a wide range of applications such as digital entertainment and law enforcement.
Knowledge-Guided Recurrent Neural Network Learning for Task-Oriented Action Prediction
This paper aims at task-oriented action prediction, i. e., predicting a sequence of actions towards accomplishing a specific task under a certain scene, which is a new problem in computer vision research.
Learning to Segment Object Candidates via Recursive Neural Networks
To avoid the exhaustive search over locations and scales, current state-of-the-art object detection systems usually involve a crucial component generating a batch of candidate object proposals from images.
Character Proposal Network for Robust Text Extraction
Maximally stable extremal regions (MSER), which is a popular method to generate character proposals/candidates, has shown superior performance in scene text detection.
DISC: Deep Image Saliency Computing via Progressive Representation Learning
Our DISC framework is capable of uniformly highlighting the objects-of-interest from complex background while preserving well object details.
