Search Results for author:
Found 57 papers, 22 papers with code
UCIP: A Universal Framework for Compressed Image Super-Resolution using Dynamic Prompt
Compressed Image Super-resolution (CSR) aims to simultaneously super-resolve the compressed images and tackle the challenging hybrid distortions caused by compression.
Text Grouping Adapter: Adapting Pre-trained Text Detector for Layout Analysis
Significant progress has been made in scene text detection models since the rise of deep learning, but scene text layout analysis, which aims to group detected text instances as paragraphs, has not kept pace.
Slot-VLM: SlowFast Slots for Video-Language Modeling
A pivotal challenge is the development of an efficient method to encapsulate video content into a set of representative tokens to align with LLMs.
Diffusion Model with Cross Attention as an Inductive Bias for Disentanglement
Disentangled representation learning strives to extract the intrinsic factors within observed data.
Retrieval-based Video Language Model for Efficient Long Video Question Answering
To address these issues, we introduce a simple yet effective retrieval-based video language model (R-VLM) for efficient and interpretable long video QA.
ObjFormer: Learning Land-Cover Changes From Paired OSM Data and Optical High-Resolution Imagery via Object-Guided Transformer
Optical high-resolution imagery and OSM data are two important data sources of change detection (CD).
Shatter and Gather: Learning Referring Image Segmentation with Text Supervision
Referring image segmentation, the task of segmenting any arbitrary entities described in free-form texts, opens up a variety of vision applications.
Diffusion Models for Image Restoration and Enhancement -- A Comprehensive Survey
Image restoration (IR) has been an indispensable and challenging task in the low-level vision field, which strives to improve the subjective quality of images distorted by various forms of degradation.
Adaptive Frequency Filters As Efficient Global Token Mixers
With this insight, we propose Adaptive Frequency Filtering (AFF) token mixer.
Vector-based Representation is the Key: A Study on Disentanglement and Compositional Generalization
In this paper, we study several typical disentangled representation learning works in terms of both disentanglement and compositional generalization abilities, and we provide an important insight: vector-based representation (using a vector instead of a scalar to represent a concept) is the key to empower both good disentanglement and strong compositional generalization.
Learning Distortion Invariant Representation for Image Restoration from A Causality Perspective
In this paper, we are the first to propose a novel training strategy for image restoration from the causality perspective, to improve the generalization ability of DNNs for unknown degradations.
Versatile Neural Processes for Learning Implicit Neural Representations
In this paper, we propose an efficient NP framework dubbed Versatile Neural Processes (VNP), which largely increases the capability of approximating functions.
Template-guided Hierarchical Feature Restoration for Anomaly Detection
Targeting for detecting anomalies of various sizes for complicated normal patterns, we propose a Template-guided Hierarchical Feature Restoration method, which introduces two key techniques, bottleneck compression and template-guided compensation, for anomaly-free feature restoration.
Ranked #16 on
Anomaly Detection
on MVTec LOCO AD
Semantic-aware Message Broadcasting for Efficient Unsupervised Domain Adaptation
In this way, our message broadcasting encourages the group tokens to learn more informative and diverse information for effective domain alignment.
Ranked #1 on
Unsupervised Domain Adaptation
on DomainNet
ReSTR: Convolution-free Referring Image Segmentation Using Transformers
Most of existing methods for this task rely heavily on convolutional neural networks, which however have trouble capturing long-range dependencies between entities in the language expression and are not flexible enough for modeling interactions between the two different modalities.
Deep Frequency Filtering for Domain Generalization
Improving the generalization ability of Deep Neural Networks (DNNs) is critical for their practical uses, which has been a longstanding challenge.
Active Token Mixer
In this work, we propose an innovative token-mixer, dubbed Active Token Mixer (ATM), to actively incorporate flexible contextual information distributed across different channels from other tokens into the given query token.
Ranked #64 on
Object Detection
on COCO minival
Mask-based Latent Reconstruction for Reinforcement Learning
For deep reinforcement learning (RL) from pixels, learning effective state representations is crucial for achieving high performance.
Lifelong Unsupervised Domain Adaptive Person Re-identification with Coordinated Anti-forgetting and Adaptation
In this paper, to address more practical scenarios, we propose a new task, Lifelong Unsupervised Domain Adaptive (LUDA) person ReID.
Domain Adaptive Person Re-Identification
Knowledge Distillation
+4
Confounder Identification-free Causal Visual Feature Learning
In this paper, we propose a novel Confounder Identification-free Causal Visual Feature Learning (CICF) method, which obviates the need for identifying confounders.
Skeleton-Based Mutually Assisted Interacted Object Localization and Human Action Recognition
Skeleton data carries valuable motion information and is widely explored in human action recognition.
WEDGE: Web-Image Assisted Domain Generalization for Semantic Segmentation
We also present a method which injects styles of the web-crawled images into training images on-the-fly during training, which enables the network to experience images of diverse styles with reliable labels for effective training.
Pose-Guided Feature Learning with Knowledge Distillation for Occluded Person Re-Identification
Occluded person re-identification (ReID) aims to match person images with occlusion.
ToAlign: Task-oriented Alignment for Unsupervised Domain Adaptation
Unsupervised domain adaptive classifcation intends to improve the classifcation performance on unlabeled target domain.
PlayVirtual: Augmenting Cycle-Consistent Virtual Trajectories for Reinforcement Learning
In this work, we propose a novel method, dubbed PlayVirtual, which augments cycle-consistent virtual trajectories to enhance the data efficiency for RL feature representation learning.
Continuous Control (100k environment steps)
Continuous Control (500k environment steps)
+3
Disentanglement-based Cross-Domain Feature Augmentation for Effective Unsupervised Domain Adaptive Person Re-identification
Each recomposed feature, obtained based on the domain-invariant feature (which enables a reliable inheritance of identity) and an enhancement from a domain specific feature (which enables the approximation of real distributions), is thus an "ideal" augmentation.
MetaAlign: Coordinating Domain Alignment and Classification for Unsupervised Domain Adaptation
For unsupervised domain adaptation (UDA), to alleviate the effect of domain shift, many approaches align the source and target domains in the feature space by adversarial learning or by explicitly aligning their statistics.
Re-energizing Domain Discriminator with Sample Relabeling for Adversarial Domain Adaptation
Many unsupervised domain adaptation (UDA) methods exploit domain adversarial training to align the features to reduce domain gap, where a feature extractor is trained to fool a domain discriminator in order to have aligned feature distributions.
Generalizing to Unseen Domains: A Survey on Domain Generalization
Domain generalization deals with a challenging setting where one or several different but related domain(s) are given, and the goal is to learn a model that can generalize to an unseen test domain.
AttributeNet: Attribute Enhanced Vehicle Re-Identification
Vehicle Re-Identification (V-ReID) is a critical task that associates the same vehicle across images from different camera viewpoints.
Ranked #1 on
Vehicle Re-Identification
on VeRi-Wild Large
Style Normalization and Restitution for Domain Generalization and Adaptation
In this paper, we design a novel Style Normalization and Restitution module (SNR) to simultaneously ensure both high generalization and discrimination capability of the networks.
Exploiting Sample Uncertainty for Domain Adaptive Person Re-Identification
Based on this finding, we propose to exploit the uncertainty (measured by consistency levels) to evaluate the reliability of the pseudo-label of a sample and incorporate the uncertainty to re-weight its contribution within various ReID losses, including the identity (ID) classification loss per sample, the triplet loss, and the contrastive loss.
Uncertainty-Aware Few-Shot Image Classification
In this work, we propose Uncertainty-Aware Few-Shot framework for image classification by modeling uncertainty of the similarities of query-support pairs and performing uncertainty-aware optimization.
Feature Alignment and Restoration for Domain Generalization and Adaptation
To ensure high discrimination, we propose a Feature Restoration (FR) operation to distill task-relevant features from the residual information and use them to compensate for the aligned features.
Ranked #80 on
Domain Generalization
on PACS
Beyond Triplet Loss: Meta Prototypical N-tuple Loss for Person Re-identification
There is a lack of loss design which enables the joint optimization of multiple instances (of multiple classes) within per-query optimization for person ReID.
Global Distance-distributions Separation for Unsupervised Person Re-identification
To address this problem, we introduce a global distance-distributions separation (GDS) constraint over the two distributions to encourage the clear separation of positive and negative samples from a global view.
Style Normalization and Restitution for Generalizable Person Re-identification
Existing fully-supervised person re-identification (ReID) methods usually suffer from poor generalization capability caused by domain gaps.
Ranked #9 on
Unsupervised Domain Adaptation
on Market to Duke
Multi-Granularity Reference-Aided Attentive Feature Aggregation for Video-based Person Re-identification
In this paper, we propose an attentive feature aggregation module, namely Multi-Granularity Reference-aided Attentive Feature Aggregation (MG-RAFA), to delicately aggregate spatio-temporal features into a discriminative video-level feature representation.
FPCR-Net: Feature Pyramidal Correlation and Residual Reconstruction for Optical Flow Estimation
To exploit such flexible and comprehensive information, we propose a semi-supervised Feature Pyramidal Correlation and Residual Reconstruction Network (FPCR-Net) for optical flow estimation from frame pairs.
Uncertainty-Aware Multi-Shot Knowledge Distillation for Image-Based Object Re-Identification
To the best of our knowledge, we are the first to make use of multi-shots of an object in a teacher-student learning manner for effectively boosting the single image based re-id.
EleAtt-RNN: Adding Attentiveness to Neurons in Recurrent Neural Networks
For an RNN block, an EleAttG is used for adaptively modulating the input by assigning different levels of importance, i. e., attention, to each element/dimension of the input.
Ranked #3 on
Skeleton Based Action Recognition
on SYSU 3D
Semantics-Aligned Representation Learning for Person Re-identification
Specifically, we build a Semantics Aligning Network (SAN) which consists of a base network as encoder (SA-Enc) for re-ID, and a decoder (SA-Dec) for reconstructing/regressing the densely semantics aligned full texture image.
CaseNet: Content-Adaptive Scale Interaction Networks for Scene Parsing
We achieve this by the context interaction among the features of different scales.
Relation-Aware Global Attention for Person Re-identification
For person re-identification (re-id), attention mechanisms have become attractive as they aim at strengthening discriminative features and suppressing irrelevant ones, which matches well the key of re-id, i. e., discriminative feature learning.
Target-Tailored Source-Transformation for Scene Graph Generation
We further explore more powerful representations by integrating language prior with the visual context in the transformation for the scene graph generation.
Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action Recognition
Skeleton-based human action recognition has attracted great interest thanks to the easy accessibility of the human skeleton data.
Ranked #1 on
Skeleton Based Action Recognition
on SYSU 3D
View Invariant 3D Human Pose Estimation
The diversity of capturing viewpoints and the flexibility of the human poses, however, remain some significant challenges.
Densely Semantically Aligned Person Re-Identification
We propose a densely semantically aligned person re-identification framework.
Temporal-Spatial Mapping for Action Recognition
We propose a video level 2D feature representation by transforming the convolutional features of all frames to a 2D feature map, referred to as VideoMap.
Ranked #51 on
Action Recognition
on UCF101
Adding Attentiveness to the Neurons in Recurrent Neural Networks
We propose adding a simple yet effective Element-wiseAttention Gate (EleAttG) to an RNN block (e. g., all RNN neurons in a network layer) that empowers the RNN neurons to have the attentiveness capability.
Ranked #102 on
Skeleton Based Action Recognition
on NTU RGB+D
View Adaptive Neural Networks for High Performance Skeleton-based Human Action Recognition
In order to alleviate the effects of view variations, this paper introduces a novel view adaptation scheme, which automatically determines the virtual observation viewpoints in a learning based data driven manner.
Ranked #1 on
Skeleton Based Action Recognition
on UWA3D
Human Pose Estimation using Global and Local Normalization
We present a two-stage normalization scheme, human body normalization and limb normalization, to make the distribution of the relative joint locations compact, resulting in easier learning of convolutional spatial models and more accurate pose estimation.
View Adaptive Recurrent Neural Networks for High Performance Human Action Recognition from Skeleton Data
Rather than re-positioning the skeletons based on a human defined prior criterion, we design a view adaptive recurrent neural network (RNN) with LSTM architecture, which enables the network itself to adapt to the most suitable observation viewpoints from end to end.
Ranked #6 on
Skeleton Based Action Recognition
on SYSU 3D
An End-to-End Spatio-Temporal Attention Model for Human Action Recognition from Skeleton Data
In this work, we propose an end-to-end spatial and temporal attention model for human action recognition from skeleton data.
Ranked #112 on
Skeleton Based Action Recognition
on NTU RGB+D
Online Human Action Detection using Joint Classification-Regression Recurrent Neural Networks
In this paper, we study the problem of online action detection from streaming skeleton data.
Co-occurrence Feature Learning for Skeleton based Action Recognition using Regularized Deep LSTM Networks
Skeleton based action recognition distinguishes human actions using the trajectories of skeleton joints, which provide a very good representation for describing actions.
