Search Results for author:
Found 102 papers, 42 papers with code
Propagating Over Phrase Relations for One-Stage Visual Grounding
Phrase level visual grounding aims to locate in an image the corresponding visual regions referred to by multiple noun phrases in a given sentence.
Self-Supervised Correction Learning for Semi-Supervised Biomedical Image Segmentation
Since the two tasks rely on similar feature information, the unlabeled data effectively enhances the representation of the network to the lesion regions and further improves the segmentation performance.
Lesion-aware Dynamic Kernel for Polyp Segmentation
Automatic and accurate polyp segmentation plays an essential role in early colorectal cancer diagnosis.
Adaptive Context Selection for Polyp Segmentation
To tackle these issues, we propose an adaptive context selection based encoder-decoder framework which is composed of Local Context Attention (LCA) module, Global Context Module (GCM) and Adaptive Selection Module (ASM).
Which Pixel to Annotate: a Label-Efficient Nuclei Segmentation Framework
Recently deep neural networks, which require a large amount of annotated samples, have been widely applied in nuclei instance segmentation of H\&E stained pathology images.
BoxPolyp:Boost Generalized Polyp Segmentation Using Extra Coarse Bounding Box Annotations
In practice, box annotations are applied to alleviate the over-fitting issue of previous polyp segmentation models, which generate fine-grained polyp area through the iterative boosted segmentation model.
Compound Batch Normalization for Long-tailed Image Classification
It can model the feature space more comprehensively and reduce the dominance of head classes.
Divide and Contrast: Source-free Domain Adaptation via Adaptive Contrastive Learning
We investigate a practical domain adaptation task, called source-free domain adaptation (SFUDA), where the source-pretrained model is adapted to the target domain without access to the source data.
OhMG: Zero-shot Open-vocabulary Human Motion Generation
After that, by formulating the generated poses from the text2pose stage as prompts, the motion generator can generate motions referring to the poses in a controllable and flexible manner.
View-Disentangled Transformer for Brain Lesion Detection
Deep neural networks (DNNs) have been widely adopted in brain lesion detection and segmentation.
Attentive Symmetric Autoencoder for Brain MRI Segmentation
Self-supervised learning methods based on image patch reconstruction have witnessed great success in training auto-encoders, whose pre-trained weights can be transferred to fine-tune other downstream tasks of image understanding.
Align, Reason and Learn: Enhancing Medical Vision-and-Language Pre-training with Knowledge
Most existing methods mainly contain three elements: uni-modal encoders (i. e., a vision encoder and a language encoder), a multi-modal fusion module, and pretext tasks, with few studies considering the importance of medical domain expert knowledge and explicitly exploiting such knowledge to facilitate Med-VLP.
Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Training
Besides, we conduct further analysis to better verify the effectiveness of different components of our approach and various settings of pre-training.
Neighborhood Collective Estimation for Noisy Label Identification and Correction
Specifically, our method is divided into two steps: 1) Neighborhood Collective Noise Verification to separate all training samples into a clean or noisy subset, 2) Neighborhood Collective Label Correction to relabel noisy samples, and then auxiliary techniques are used to assist further model optimization.
Robust Real-World Image Super-Resolution against Adversarial Attacks
Since the frequency masking may not only destroys the adversarial perturbations but also affects the sharp details in a clean image, we further develop an adversarial sample classifier based on the frequency domain of images to determine if applying the proposed mask module.
Centrality and Consistency: Two-Stage Clean Samples Identification for Learning with Instance-Dependent Noisy Labels
In this paper, we propose a two-stage clean samples identification method to address the aforementioned challenge.
Ranked #3 on
Image Classification
on Clothing1M
(using extra training data)
Cross-Modal Causal Relational Reasoning for Event-Level Visual Question Answering
Existing visual question answering methods tend to capture the cross-modal spurious correlations, and fail to discover the true causal mechanism that facilitates reasoning truthfully based on the dominant visual evidence and the question intention.
Less is More: Adaptive Curriculum Learning for Thyroid Nodule Diagnosis
Thyroid nodule classification aims at determining whether the nodule is benign or malignant based on a given ultrasound image.
BronchusNet: Region and Structure Prior Embedded Representation Learning for Bronchus Segmentation and Classification
CT-based bronchial tree analysis plays an important role in the computer-aided diagnosis for respiratory diseases, as it could provide structured information for clinicians.
Multi-level Consistency Learning for Semi-supervised Domain Adaptation
Semi-supervised domain adaptation (SSDA) aims to apply knowledge learned from a fully labeled source domain to a scarcely labeled target domain.
Dual Adversarial Adaptation for Cross-Device Real-World Image Super-Resolution
To address this issue, we propose an unsupervised domain adaptation mechanism for real-world SR, named Dual ADversarial Adaptation (DADA), which only requires LR images in the target domain with available real paired data from a source camera.
Causal Reasoning Meets Visual Representation Learning: A Prospective Study
Visual representation learning is ubiquitous in various real-world applications, including visual comprehension, video understanding, multi-modal analysis, human-computer interaction, and urban computing.
Out-of-Distribution Generalization
Representation Learning
+1
Open Set Domain Adaptation By Novel Class Discovery
In Open Set Domain Adaptation (OSDA), large amounts of target samples are drawn from the implicit categories that never appear in the source domain.
X-Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioning
Thus, a more faithful caption can be generated only using point clouds during the inference.
Unsupervised Domain Adaptive Salient Object Detection Through Uncertainty-Aware Pseudo-Label Learning
To relieve the burden of labor-intensive labeling, deep unsupervised SOD methods have been proposed to exploit noisy labels generated by handcrafted saliency methods.
PointMatch: A Consistency Training Framework for Weakly Supervised Semantic Segmentation of 3D Point Clouds
Semantic segmentation of point cloud usually relies on dense annotation that is exhausting and costly, so it attracts wide attention to investigate solutions for the weakly supervised scheme with only sparse points annotated.
Representation Learning
Weakly supervised Semantic Segmentation
+1
Cross-level Contrastive Learning and Consistency Constraint for Semi-supervised Medical Image Segmentation
Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation.
Aerial Images Meet Crowdsourced Trajectories: A New Approach to Robust Road Extraction
Land remote sensing analysis is a crucial research in earth science.
Explore before Moving: A Feasible Path Estimation and Memory Recalling Framework for Embodied Navigation
PEMR includes a "looking ahead" process, \textit{i. e.} a visual feature extractor module that estimates feasible paths for gathering 3D navigational information, which is mimicking the human sense of direction.
Road Network Guided Fine-Grained Urban Traffic Flow Inference
Subsequently, we incorporate the road network feature and coarse-grained flow feature to regularize the short-range spatial distribution modeling of road-relative traffic flow.
Trash to Treasure: Harvesting OOD Data with Cross-Modal Matching for Open-Set Semi-Supervised Learning
Open-set semi-supervised learning (open-set SSL) investigates a challenging but practical scenario where out-of-distribution (OOD) samples are contained in the unlabeled data.
Towards Interpretable Deep Networks for Monocular Depth Estimation
Based on our observations, we quantify the interpretability of a deep MDE network by the depth selectivity of its hidden units.
Weakly-Supervised Spatio-Temporal Anomaly Detection in Surveillance Video
In this paper, we introduce a novel task, referred to as Weakly-Supervised Spatio-Temporal Anomaly Detection (WSSTAD) in surveillance video.
Colorectal Polyp Classification from White-light Colonoscopy Images via Domain Alignment
Thus, we propose a novel framework based on a teacher-student architecture for the accurate colorectal polyp classification (CPC) through directly using white-light (WL) colonoscopy images in the examination.
Online Metro Origin-Destination Prediction via Heterogeneous Information Aggregation
In this work, we proposed a novel neural network module termed Heterogeneous Information Aggregation Machine (HIAM), which fully exploits heterogeneous information of historical data (e. g., incomplete OD matrices, unfinished order vectors, and DO matrices) to jointly learn the evolutionary patterns of OD and DO ridership.
Bottom-Up Shift and Reasoning for Referring Image Segmentation
In this paper, we tackle the challenge by jointly performing compositional visual reasoning and accurate segmentation in a single stage via the proposed novel Bottom-Up Shift (BUS) and Bidirectional Attentive Refinement (BIAR) modules.
Cross-Modal Progressive Comprehension for Referring Segmentation
In this paper, we propose a Cross-Modal Progressive Comprehension (CMPC) scheme to effectively mimic human behaviors and implement it as a CMPC-I (Image) module and a CMPC-V (Video) module to improve referring image and video segmentation models.
Ranked #4 on
Referring Expression Segmentation
on J-HMDB
Collaborative Spatial-Temporal Modeling for Language-Queried Video Actor Segmentation
Though 3D convolutions are amenable to recognizing which actor is performing the queried actions, it also inevitably introduces misaligned spatial information from adjacent frames, which confuses features of the target frame and yields inaccurate segmentation.
Ranked #5 on
Referring Expression Segmentation
on J-HMDB
Cross-Domain Adaptive Clustering for Semi-Supervised Domain Adaptation
Pseudo labeling expands the number of ``labeled" samples in each class in the target domain, and thus produces a more robust and powerful cluster core for each class to facilitate adversarial learning.
Deep Transformers for Fast Small Intestine Grounding in Capsule Endoscope Video
In this paper, we propose a deep model to ground shooting range of small intestine from a capsule endoscope video which has duration of tens of hours.
Scene-Intuitive Agent for Remote Embodied Visual Grounding
Intuitively, we comprehend the semantics of the instruction to form an overview of where a bathroom is and what a blue towel is in mind; then, we navigate to the target location by consistently matching the bathroom appearance in mind with the current scene.
LapsCore: Language-Guided Person Search via Color Reasoning
The key point of language-guided person search is to construct the cross-modal association between visual and textual input.
Adversarial Training using Contrastive Divergence
To protect the security of machine learning models against adversarial examples, adversarial training becomes the most popular and powerful strategy against various adversarial attacks by injecting adversarial examples into training data.
Cross-Modal Collaborative Representation Learning and a Large-Scale RGBT Benchmark for Crowd Counting
Extensive experiments conducted on the RGBT-CC benchmark demonstrate the effectiveness of our framework for RGBT crowd counting.
Human-centric Spatio-Temporal Video Grounding With Visual Transformers
HC-STVG is a video grounding task that requires both spatial (where) and temporal (when) localization.
A Hamiltonian Monte Carlo Method for Probabilistic Adversarial Attack and Learning
Although deep convolutional neural networks (CNNs) have demonstrated remarkable performance on multiple computer vision tasks, researches on adversarial learning have shown that deep models are vulnerable to adversarial examples, which are crafted by adding visually imperceptible perturbations to the input images.
Contralaterally Enhanced Networks for Thoracic Disease Detection
Aimed at improving the performance of existing detection methods, we propose a deep end-to-end module to exploit the contralateral context information for enhancing feature representations of disease proposals.
Linguistic Structure Guided Context Modeling for Referring Image Segmentation
Referring image segmentation aims to predict the foreground mask of the object referred by a natural language sentence.
Referring Image Segmentation via Cross-Modal Progressive Comprehension
In addition to the CMPC module, we further leverage a simple yet effective TGFE module to integrate the reasoned multimodal features from different levels with the guidance of textual information.
Ranked #7 on
Referring Expression Segmentation
on RefCOCO testB
Reinforcement Learning for Weakly Supervised Temporal Grounding of Natural Language in Untrimmed Videos
Temporal grounding of natural language in untrimmed videos is a fundamental yet challenging multimedia task facilitating cross-media visual content retrieval.
Collaborative Training between Region Proposal Localization and Classification for Domain Adaptive Object Detection
Domain adaptation for object detection tries to adapt the detector from labeled datasets to unlabeled ones for better performance.
Online Alternate Generator against Adversarial Attacks
The field of computer vision has witnessed phenomenal progress in recent years partially due to the development of deep convolutional neural networks.
Semantics-aware Adaptive Knowledge Distillation for Sensor-to-Vision Action Recognition
In this paper, we propose a novel framework, named Semantics-aware Adaptive Knowledge Distillation Networks (SAKDN), to enhance action recognition in vision-sensor modality (videos) by adaptively transferring and distilling the knowledge from multiple wearable sensors.
Graph-Structured Referring Expression Reasoning in The Wild
The linguistic structure of a referring expression provides a layout of reasoning over the visual contents, and it is often crucial to align and jointly understand the image and the referring expression.
Efficient Crowd Counting via Structured Knowledge Transfer
Crowd counting is an application-oriented task and its inference efficiency is crucial for real-world applications.
Peeking into occluded joints: A novel framework for crowd pose estimation
Although occlusion widely exists in nature and remains a fundamental challenge for pose estimation, existing heatmap-based approaches suffer serious degradation on occlusions.
Depthwise Non-local Module for Fast Salient Object Detection Using a Single Thread
The proposed algorithm for the first time achieves competitive accuracy and high inference efficiency simultaneously with a single CPU thread.
Tree-Structured Policy based Progressive Reinforcement Learning for Temporally Language Grounding in Video
Temporally language grounding in untrimmed videos is a newly-raised task in video understanding.
Physical-Virtual Collaboration Modeling for Intra-and Inter-Station Metro Ridership Prediction
To address this problem, we model a metro system as graphs with various topologies and propose a unified Physical-Virtual Collaboration Graph Network (PVCGN), which can effectively learn the complex ridership patterns from the tailor-designed graphs.
An Adversarial Perturbation Oriented Domain Adaptation Approach for Semantic Segmentation
In contrast to adversarial alignment, we propose to explicitly train a domain-invariant classifier by generating and defensing against pointwise feature space adversarial perturbations.
Globally Guided Progressive Fusion Network for 3D Pancreas Segmentation
Recently 3D volumetric organ segmentation attracts much research interest in medical image analysis due to its significance in computer aided diagnosis.
Self-Enhanced Convolutional Network for Facial Video Hallucination
It further recurrently exploits the reconstructed results and intermediate features of a sequence of preceding frames to improve the initial super-resolution of the current frame by modelling the coherence of structural facial features across frames.
Knowledge Graph Transfer Network for Few-Shot Recognition
In this work, we represent the semantic correlations in the form of structured knowledge graph and integrate this graph into deep neural networks to promote few-shot learning by a novel Knowledge Graph Transfer Network (KGTN).
Generalizing Energy-based Generative ConvNets from Particle Evolution Perspective
Compared with Generative Adversarial Networks (GAN), Energy-Based generative Models (EBMs) possess two appealing properties: i) they can be directly optimized without requiring an auxiliary network during the learning and synthesizing; ii) they can better approximate underlying distribution of the observed data by learning explicitly potential functions.
Learning to Recognize the Unseen Visual Predicates
Visual relationship recognition models are limited in the ability to generalize from finite seen predicates to unseen ones.
Dynamic Graph Attention for Referring Expression Comprehension
In this paper, we explore the problem of referring expression comprehension from the perspective of language-driven visual reasoning, and propose a dynamic graph attention network to perform multi-step reasoning by modeling both the relationships among the objects in the image and the linguistic structure of the expression.
Motion Guided Attention for Video Salient Object Detection
In this paper, we develop a multi-task motion guided video salient object detection network, which learns to accomplish two sub-tasks using two sub-networks, one sub-network for salient object detection in still images and the other for motion saliency detection in optical flow images.
A Real-Time Cross-modality Correlation Filtering Method for Referring Expression Comprehension
RCCF reformulates the referring expression comprehension as a correlation filtering process.
Dynamic Spatial-Temporal Representation Learning for Traffic Flow Prediction
Specifically, the first ConvLSTM unit takes normal traffic flow features as input and generates a hidden state at each time-step, which is further fed into the connected convolutional layer for spatial attention map inference.
Fashion Retrieval via Graph Reasoning Networks on a Similarity Pyramid
To address this issue, we propose a novel Graph Reasoning Network (GRNet) on a Similarity Pyramid, which learns similarities between a query and a gallery cloth by using both global and local representations in multiple scales.
Ranked #4 on
Image Retrieval
on DeepFashion - Consumer-to-shop
(Rank-1 metric)
Crowd Counting with Deep Structured Scale Integration Network
Automatic estimation of the number of people in unconstrained crowded scenes is a challenging task and one major difficulty stems from the huge scale variation of people.
Semi-Supervised Video Salient Object Detection Using Pseudo-Labels
Specifically, we present an effective video saliency detector that consists of a spatial refinement network and a spatiotemporal module.
Ranked #1 on
Video Salient Object Detection
on VOS-T
(using extra training data)
Semi-supervised Skin Detection by Network with Mutual Guidance
In this paper we present a new data-driven method for robust skin detection from a single human portrait image.
Multivariate-Information Adversarial Ensemble for Scalable Joint Distribution Matching
A broad range of cross-$m$-domain generation researches boil down to matching a joint distribution by deep generative models (DGMs).
Relationship-Embedded Representation Learning for Grounding Referring Expressions
Unfortunately, existing work on grounding referring expressions fails to accurately extract multi-order relationships from the referring expression and associate them with the objects and their related contexts in the image.
Contextualized Spatial-Temporal Network for Taxi Origin-Destination Demand Prediction
Finally, a GCC module is applied to model the correlation between all regions by computing a global correlation feature as a weighted sum of all regional features, with the weights being calculated as the similarity between the corresponding region pairs.
ROSA: Robust Salient Object Detection against Adversarial Attacks
To our knowledge, this paper is the first one that mounts successful adversarial attacks on salient object detection models and verifies that adversarial samples are effective on a wide range of existing methods.
Face Hallucination by Attentive Sequence Optimization with Reinforcement Learning
Face hallucination is a domain-specific super-resolution problem that aims to generate a high-resolution (HR) face image from a low-resolution~(LR) input.
Semantic Relationships Guided Representation Learning for Facial Action Unit Recognition
Specifically, by analyzing the symbiosis and mutual exclusion of AUs in various facial expressions, we organize the facial AUs in the form of structured knowledge-graph and integrate a Gated Graph Neural Network (GGNN) in a multi-scale CNN framework to propagate node information through the graph for generating enhanced AU representation.
Harvesting Visual Objects from Internet Images via Deep Learning Based Objectness Assessment
As a concrete example, a database of over 1. 2 million visual objects has been built using the proposed method, and has been successfully used in various data-driven image applications.
Deep RBFNet: Point Cloud Feature Learning using Radial Basis Functions
Three-dimensional object recognition has recently achieved great progress thanks to the development of effective point cloud-based learning frameworks, such as PointNet and its extensions.
Facial Landmark Machines: A Backbone-Branches Architecture with Progressive Representation Learning
In this paper, we propose a novel cascaded backbone-branches fully convolutional neural network~(BB-FCN) for rapidly and accurately localizing facial landmarks in unconstrained and cluttered settings.
FRAME Revisited: An Interpretation View Based on Particle Evolution
FRAME (Filters, Random fields, And Maximum Entropy) is an energy-based descriptive model that synthesizes visual realism by capturing mutual patterns from structural input signals.
Larger Norm More Transferable: An Adaptive Feature Norm Approach for Unsupervised Domain Adaptation
Domain adaptation enables the learner to safely generalize into novel environments by mitigating domain shifts across distributions.
Ranked #6 on
Domain Adaptation
on ImageCLEF-DA
Cross-Modal Attentional Context Learning for RGB-D Object Detection
In this paper, we address this problem by developing a Cross-Modal Attentional Context (CMAC) learning framework, which enables the full exploitation of the context information from both RGB and depth data.
Learning Deep Representations for Semantic Image Parsing: a Comprehensive Overview
Semantic image parsing, which refers to the process of decomposing images into semantic regions and constructing the structure representation of the input, has recently aroused widespread interest in the field of computer vision.
Attentive Crowd Flow Machines
Traffic flow prediction is crucial for urban traffic management and public safety.
Non-locally Enhanced Encoder-Decoder Network for Single Image De-raining
Single image rain streaks removal has recently witnessed substantial progress due to the development of deep convolutional neural networks.
Crowd Counting using Deep Recurrent Spatial-Aware Network
Crowd counting from unconstrained scene images is a crucial task in many real-world applications like urban surveillance and management, but it is greatly challenged by the camera's perspective that causes huge appearance variations in people's scales and rotations.
Interpretable Video Captioning via Trajectory Structured Localization
Automatically describing open-domain videos with natural language are attracting increasing interest in the field of artificial intelligence.
Flow Guided Recurrent Neural Encoder for Video Salient Object Detection
Image saliency detection has recently witnessed significant progress due to deep convolutional neural networks.
Ranked #2 on
Video Salient Object Detection
on DAVSOD-Difficult20
(using extra training data)
Visual Question Reasoning on General Dependency Tree
This network comprises of two collaborative modules: i) an adversarial attention module to exploit the local visual evidence for each word parsed from the question; ii) a residual composition module to compose the previously mined evidence.
Contrast-Oriented Deep Neural Networks for Salient Object Detection
In this paper, we develop hybrid contrast-oriented deep neural networks to overcome the aforementioned limitations.
Weakly Supervised Salient Object Detection Using Image Labels
Our algorithm is based on alternately exploiting a graphical model and training a fully convolutional network for model updating.
Context-Aware Semantic Inpainting
Our proposed GAN-based framework consists of a fully convolutional design for the generator which helps to better preserve spatial structures and a joint loss function with a revised perceptual loss to capture high-level semantics in the context.
Recurrent Attentional Reinforcement Learning for Multi-label Image Recognition
Recognizing multiple labels of images is a fundamental but challenging task in computer vision, and remarkable progress has been attained by localizing semantic-aware image regions and predicting their labels with deep convolutional neural networks.
Multi-label Image Recognition by Recurrently Discovering Attentional Regions
This paper proposes a novel deep architecture to address multi-label image recognition, a fundamental and practical task towards general visual understanding.
Attention-Aware Face Hallucination via Deep Reinforcement Learning
Face hallucination is a domain-specific super-resolution problem with the goal to generate high-resolution (HR) faces from low-resolution (LR) input images.
Instance-Level Salient Object Segmentation
Image saliency detection has recently witnessed rapid progress due to deep convolutional neural networks.
Ranked #17 on
RGB Salient Object Detection
on DUTS-TE
Visual Saliency Detection Based on Multiscale Deep CNN Features
The penultimate layer of our neural network has been confirmed to be a discriminative high-level feature vector for saliency detection, which we call deep contrast feature.
Deep Contrast Learning for Salient Object Detection
Our deep network consists of two complementary components, a pixel-level fully convolutional stream and a segment-wise spatial pooling stream.
Ranked #22 on
RGB Salient Object Detection
on DUTS-TE
Visual Saliency Based on Multiscale Deep Features
Visual saliency is a fundamental problem in both cognitive and computational sciences, including computer vision.
