Search Results for author:
Found 75 papers, 32 papers with code
W-HMR: Human Mesh Recovery in World Space with Weak-supervised Camera Calibration and Orientation Correction
Decoupling body orientation and body pose enables our model to consider the accuracy in camera coordinate and the reasonableness in world coordinate simultaneously, expanding the range of applications.
Multi-view Information Integration and Propagation for Occluded Person Re-identification
Moreover, as multiple images with the same identity are not accessible in the testing stage, we devise an Information Propagation (IP) mechanism to distill knowledge from the comprehensive representation to that of a single occluded image.
Learning Comprehensive Representations with Richer Self for Text-to-Image Person Re-Identification
Since the support set is unavailable during inference, we propose to distill the knowledge learned by the "richer" model into a lightweight model for inference with a single image/text as input.
Towards Unified Deep Image Deraining: A Survey and A New Benchmark
In this paper, we provide a comprehensive review of existing image deraining method and provide a unify evaluation setting to evaluate the performance of image deraining methods.
M$^3$Net: Multi-view Encoding, Matching, and Fusion for Few-shot Fine-grained Action Recognition
Due to the scarcity of manually annotated data required for fine-grained video understanding, few-shot fine-grained (FS-FG) action recognition has gained significant attention, with the aim of classifying novel fine-grained action categories with only a few labeled instances.
Erasing, Transforming, and Noising Defense Network for Occluded Person Re-Identification
Occlusion perturbation presents a significant challenge in person re-identification (re-ID), and existing methods that rely on external visual cues require additional computational resources and only consider the issue of missing information caused by occlusion.
LUT-GCE: Lookup Table Global Curve Estimation for Fast Low-light Image Enhancement
To further speed up the inference speed, a lookup table method is employed for fast retrieval.
Multi-Granularity Denoising and Bidirectional Alignment for Weakly Supervised Semantic Segmentation
Weakly supervised semantic segmentation (WSSS) models relying on class activation maps (CAMs) have achieved desirable performance comparing to the non-CAMs-based counterparts.
Coupling Global Context and Local Contents for Weakly-Supervised Semantic Segmentation
Specifically, a flexible context aggregation module is proposed to capture the global object context in different granular spaces.
Weakly supervised Semantic Segmentation
Weakly-Supervised Semantic Segmentation
VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
Different from widely-studied vision-language pretraining models, VALOR jointly models relationships of vision, audio and language in an end-to-end manner.
Ranked #1 on
Video Captioning
on VATEX
(using extra training data)
Semantic Scene Completion with Cleaner Self
SSC is a well-known ill-posed problem as the prediction model has to "imagine" what is behind the visible surface, which is usually represented by Truncated Signed Distance Function (TSDF).
Spatially-Adaptive Feature Modulation for Efficient Image Super-Resolution
Although numerous solutions have been proposed for image super-resolution, they are usually incompatible with low-power devices with many computational and memory constraints.
Triplet Contrastive Representation Learning for Unsupervised Vehicle Re-identification
To address this problem, in this paper, we propose a simple Triplet Contrastive Representation Learning (TCRL) framework which leverages cluster features to bridge the part features and global features for unsupervised vehicle re-identification.
DLGSANet: Lightweight Dynamic Local and Global Self-Attention Networks for Image Super-Resolution
We develop a hybrid dynamic-Transformer block(HDTB) that integrates the MHDLSA and SparseGSA for both local and global feature exploration.
Deep Discriminative Spatial and Temporal Network for Efficient Video Deblurring
In contrast to existing methods that directly align adjacent frames without discrimination, we develop a deep discriminative spatial and temporal network to facilitate the spatial and temporal feature exploration for better video deblurring.
Multi-Scale Residual Low-Pass Filter Network for Image Deblurring
We present a simple and effective Multi-scale Residual Low-Pass Filter Network (MRLPFNet) that jointly explores the image details and main structures for image deblurring.
BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorization
To overcome this problem, we further develop a mixed expert block to extract semantic information for modeling the object boundaries of frames so that the semantic image prior can better guide the colorization process for better performance.
SLLEN: Semantic-aware Low-light Image Enhancement Network
How to effectively explore semantic feature is vital for low-light image enhancement (LLE).
CLIP-Driven Fine-grained Text-Image Person Re-identification
Secondly, cross-grained feature refinement (CFR) and fine-grained correspondence discovery (FCD) modules are proposed to establish the cross-grained and fine-grained interactions between modalities, which can filter out non-modality-shared image patches/words and mine cross-modal correspondences from coarse to fine.
ADPS: Asymmetric Distillation Post-Segmentation for Image Anomaly Detection
However, existing KDAD methods suffer from two main limitations: 1) the student network can effortlessly replicate the teacher network's representations, and 2) the features of the teacher network serve solely as a ``reference standard" and are not fully leveraged.
Centralized Feature Pyramid for Object Detection
To address this problem, in this paper, we propose a Centralized Feature Pyramid (CFP) for object detection, which is based on a globally explicit centralized feature regulation.
Boosting Few-shot Fine-grained Recognition with Background Suppression and Foreground Alignment
To address this challenging task, we propose a two-stage background suppression and foreground alignment framework, which is composed of a background activation suppression (BAS) module, a foreground object alignment (FOA) module, and a local-to-local (L2L) similarity metric.
Accurate and Efficient Stereo Matching via Attention Concatenation Volume
In this paper, we present a novel cost volume construction method, named attention concatenation volume (ACV), which generates attention weights from correlation clues to suppress redundant information and enhance matching-related information in the concatenation volume.
Understanding the Tricks of Deep Learning in Medical Image Segmentation: Challenges and Future Directions
Over the past few years, the rapid development of deep learning technologies for computer vision has significantly improved the performance of medical image segmentation (MedISeg).
Graph Reasoning Transformer for Image Parsing
In this paper, we propose a novel Graph Reasoning Transformer (GReaT) for image parsing to enable image patches to interact following a relation reasoning pattern.
Image-Specific Information Suppression and Implicit Local Alignment for Text-based Person Search
Moreover, existing methods seldom consider the information inequality problem between modalities caused by image-specific information.
Hierarchical Feature Alignment Network for Unsupervised Video Object Segmentation
Optical flow is an easily conceived and precious cue for advancing unsupervised video object segmentation (UVOS).
A Competitive Method for Dog Nose-print Re-identification
Vision-based pattern identification (such as face, fingerprint, iris etc.)
ShuffleMixer: An Efficient ConvNet for Image Super-Resolution
We propose a simple and effective approach, ShuffleMixer, for lightweight image super-resolution that explores large convolution and channel split-shuffle operation.
PNP: Robust Learning From Noisy Labels by Probabilistic Noise Prediction
Label noise has been a practical challenge in deep learning due to the strong capability of deep neural networks in fitting all training data.
sub-region localized hashing for fine-grained image retrieval
Specifically, to localize diverse local regions, a sub-region localization module is developed to learn discriminative local features by locating the peaks of non-overlap sub-regions in the feature map.
Video-Text Pre-training with Learned Regions
Video-Text pre-training aims at learning transferable representations from large-scale video-text pairs via aligning the semantics between visual and textual information.
Fine-Grained Image Analysis with Deep Learning: A Survey
Fine-grained image analysis (FGIA) is a longstanding and fundamental problem in computer vision and pattern recognition, and underpins a diverse set of real-world applications.
Improving OCR-Based Image Captioning by Incorporating Geometrical Relationship
Under the guidance of the geometrical relationship between OCR tokens, our LSTM-R capitalizes on a newly-devised relation-aware pointer network to select OCR tokens from the scene text for OCR-based image captioning.
CTNet: Context-based Tandem Network for Semantic Segmentation
Specifically, the Spatial Contextual Module (SCM) is leveraged to uncover the spatial contextual dependency between pixels by exploring the correlation between pixels and categories.
Ranked #70 on
Semantic Segmentation
on ADE20K val
Interactive Fusion of Multi-level Features for Compositional Activity Recognition
To understand a complex action, multiple sources of information, including appearance, positional, and semantic features, need to be integrated.
Generalized Focal Loss V2: Learning Reliable Localization Quality Estimation for Dense Object Detection
Such a property makes the distribution statistics of a bounding box highly correlated to its real localization quality.
Ranked #27 on
Object Detection
on COCO-O
Causal Intervention for Weakly-Supervised Semantic Segmentation
We present a causal inference framework to improve Weakly-Supervised Semantic Segmentation (WSSS).
Ranked #28 on
Weakly-Supervised Semantic Segmentation
on COCO 2014 val
Feature Pyramid Transformer
Yet, the non-local spatial interactions are not across scales, and thus they fail to capture the non-local contexts of objects (or parts) residing in different scales.
Social Adaptive Module for Weakly-supervised Group Activity Recognition
This paper presents a new task named weakly-supervised group activity recognition (GAR) which differs from conventional GAR tasks in that only video-level labels are available, yet the important persons within each frame are not provided even in the training data.
Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection
Specifically, we merge the quality estimation into the class prediction vector to form a joint representation of localization quality and classification, and use a vector to represent arbitrary distribution of box locations.
Ranked #107 on
Object Detection
on COCO test-dev
Cascaded Deep Video Deblurring Using Temporal Sharpness Prior
The proposed algorithm mainly consists of optical flow estimation from intermediate latent frames and latent frame restoration steps.
Ranked #2 on
Deblurring
on DVD
(using extra training data)
Deep Blind Video Super-resolution
Existing video super-resolution (SR) algorithms usually assume that the blur kernels in the degradation process are known and do not model the blur kernels in the restoration.
Adaptive Context Network for Scene Parsing
Recent works attempt to improve scene parsing performance by exploring different levels of contexts, and typically train a well-designed convolutional network to exploit useful contexts across all pixels equally.
Ranked #71 on
Semantic Segmentation
on ADE20K val
Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Prediction
To this end, we propose a novel Skeleton-joint Co-attention Recurrent Neural Networks (SC-RNN) to capture the spatial coherence among joints, and the temporal evolution among skeletons simultaneously on a skeleton-joint co-attention feature map in spatiotemporal space.
Image Formation Model Guided Deep Image Super-Resolution
We present a simple and effective image super-resolution algorithm that imposes an image formation constraint on the deep neural networks via pixel substitution.
Aligning Linguistic Words and Visual Semantic Units for Image Captioning
Image captioning attempts to generate a sentence composed of several linguistic words, which are used to describe objects, attributes, and interactions in an image, denoted as visual semantic units in this paper.
Convolutional Auto-encoding of Sentence Topics for Image Paragraph Generation
A valid question is how to encapsulate such gists/topics that are worthy of mention from an image, and then describe the image from one topic to another but holistically with a coherent structure.
Modeling Embedding Dimension Correlations via Convolutional Neural Collaborative Filtering
In this work, we emphasize on modeling the correlations among embedding dimensions in neural networks to pursue higher effectiveness for CF.
Joint Label Prediction based Semi-Supervised Adaptive Concept Factorization for Robust Data Representation
To enrich prior knowledge to enhance the discrimination, RS2ACF clearly uses class information of labeled data and more importantly propagates it to unlabeled data by jointly learning an explicit label indicator for unlabeled data.
Supervised Quantization for Similarity Search
In this paper, we address the problem of searching for semantically similar images from a large database.
Deep Semantic Multimodal Hashing Network for Scalable Image-Text and Video-Text Retrievals
In this article, we propose a novel deep semantic multimodal hashing network (DSMHN) for scalable image-text and video-text retrieval.
Designing by Training: Acceleration Neural Network for Fast High-Dimensional Convolution
Over the decades, people took a handmade approach to design fast algorithms for the Gaussian convolution.
Fast Matrix Factorization with Non-Uniform Weights on Missing Data
This poses an imbalanced learning problem, since the scale of missing entries is usually much larger than that of observed entries, but they cannot be ignored due to the valuable negative signal.
Hierarchical Long Short-Term Concurrent Memory for Human Interaction Recognition
In a Co-LSTM unit, each sub-memory unit stores individual motion information, while this Co-LSTM unit selectively integrates and stores inter-related motion information between multiple interacting persons from multiple sub-memory units via the cell gate and co-memory cell, respectively.
Ranked #1 on
Human Interaction Recognition
on UT
Adversarial Training Towards Robust Multimedia Recommender System
To this end, we propose a novel solution named Adversarial Multimedia Recommendation (AMR), which can lead to a more robust multimedia recommender model by using adversarial learning.
Information Retrieval Multimedia
Outer Product-based Neural Collaborative Filtering
In this work, we contribute a new multi-layer neural network architecture named ONCF to perform collaborative filtering.
Physics-Based Generative Adversarial Models for Image Restoration and Beyond
We present an algorithm to directly solve numerous image restoration problems (e. g., image deblurring, image dehazing, image deraining, etc.).
Single Image Dehazing via Conditional Generative Adversarial Network
In contrast, we solve this problem based on a conditional generative adversarial network (cGAN), where the clear image is estimated by an end-to-end trainable neural network.
Learning Dual Convolutional Neural Networks for Low-Level Vision
These problems usually involve the estimation of two components of the target signals: structures and details.
Deep Ordinal Hashing with Spatial Attention
However, most existing deep hashing methods directly learn the hash functions by encoding the global semantic information, while ignoring the local spatial information of images.
Social Anchor-Unit Graph Regularized Tensor Completion for Large-Scale Image Retagging
Recent approaches simultaneously explore visual, user and tag information to improve the performance of image retagging by constructing and exploring an image-tag-user graph.
Hardware-Efficient Guided Image Filtering For Multi-Label Problem
In this paper we propose a hardware-efficient Guided Filter (HGF), which solves the efficiency problem of multichannel guided image filtering and yields competent results when applying it to multi-label problems with synthesized polynomial multichannel guidance.
Modeling Multimodal Clues in a Hybrid Deep Learning Framework for Video Classification
More specifically, we utilize three Convolutional Neural Networks (CNNs) operating on appearance, motion and audio signals to extract their corresponding features.
Personalized Age Progression with Bi-level Aging Dictionary Learning
Basically, for each age group, we learn an aging dictionary to reveal its aging characteristics (e. g., wrinkles), where the dictionary bases corresponding to the same index yet from two neighboring aging dictionaries form a particular aging pattern cross these two age groups, and a linear combination of all these patterns expresses a particular personalized aging process.
Concurrence-Aware Long Short-Term Sub-Memories for Person-Person Action Recognition
To this end, we propose a novel Concurrence-Aware Long Short-Term Sub-Memories (Co-LSTSM) to model the long-term inter-related dynamics between two interacting people on the bounding boxes covering people.
Ranked #2 on
Human Interaction Recognition
on BIT
Deep Learning Driven Visual Path Prediction from a Single Image
The highly effective visual representation and deep context models ensure that our framework makes a deep semantic understanding of the scene and motion pattern, consequently improving the performance of the visual path prediction task.
Human Parsing With Contextualized Convolutional Neural Network
In this work, we address the human parsing task with a novel Contextualized Convolutional Neural Network (Co-CNN) architecture, which well integrates the cross-layer context, global image-level context, within-super-pixel context and cross-super-pixel neighborhood context into a unified network.
Nonconvex Nonsmooth Low-Rank Minimization via Iteratively Reweighted Nuclear Norm
The nuclear norm is widely used as a convex surrogate of the rank function in compressive sensing for low rank matrix recovery with its applications in image recovery and signal processing.
Personalized Age Progression with Aging Dictionary
Second, it is challenging or even impossible to collect faces of all age groups for a particular subject, yet much easier and more practical to get face pairs from neighboring age groups.
Sparse Composite Quantization
The benefit is that the distance evaluation between the query and the dictionary element (a sparse vector) is accelerated using the efficient sparse vector operation, and thus the cost of distance table computation is reduced a lot.
Correntropy Induced L2 Graph for Robust Subspace Clustering
In this paper, we study the robust subspace clustering problem, which aims to cluster the given possibly noisy data points into their underlying subspaces.
Constructing a Non-Negative Low Rank and Sparse Graph with Data-Adaptive Features
This paper aims at constructing a good graph for discovering intrinsic data structures in a semi-supervised learning setting.
Generalized Nonconvex Nonsmooth Low-Rank Minimization
We observe that all the existing nonconvex penalty functions are concave and monotonically increasing on $[0,\infty)$.
Weakly-Supervised Dual Clustering for Image Semantic Segmentation
In this paper, we propose a novel Weakly-Supervised Dual Clustering (WSDC) approach for image semantic segmentation with image-level labels, i. e., collaboratively performing image segmentation and tag alignment with those regions.
