Search Results for author:
Found 64 papers, 31 papers with code
Enabling Deep Residual Networks for Weakly Supervised Object Detection
Weakly supervised object detection (WSOD) has attracted extensive research attention due to its great flexibility of exploiting large-scale image-level annotation for detector training.
Accelerating Vision-Language Pretraining with Free Language Modeling
FLM successfully frees the prediction rate from the tie-up with the corruption rate while allowing the corruption spans to be customized for each token to be predicted.
Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline
To better adapt to real-life applications, in this paper we focus on the task of dense-localizing audio-visual events, which aims to jointly localize and recognize all audio-visual events occurring in an untrimmed video.
Learning Grounded Vision-Language Representation for Versatile Understanding in Untrimmed Videos
TEG learns to adaptively ground the possible event proposals given a set of sentences by estimating the cross-modal distance in a joint semantic space.
On the Stability and Generalization of Triplet Learning
Triplet learning, i. e. learning from triplet data, has attracted much attention in computer vision tasks with an extremely large number of categories, e. g., face recognition and person re-identification.
IM-IAD: Industrial Image Anomaly Detection Benchmark in Manufacturing
We realize that the lack of actual IM settings most probably hinders the development and usage of these methods in real-world applications.
Pushing the Limits of Fewshot Anomaly Detection in Industry Vision: Graphcore
Besides, we provide a novel model GraphCore via VIIFs that can fast implement unsupervised FSAD training and can improve the performance of anomaly detection.
Deep Industrial Image Anomaly Detection: A Survey
In this paper, we provide a comprehensive review of deep learning-based image anomaly detection techniques, from the perspectives of neural network architectures, levels of supervision, loss functions, metrics and datasets.
Learning Dual-Fused Modality-Aware Representations for RGBD Tracking
However, some existing RGBD trackers use the two modalities separately and thus some particularly useful shared information between them is ignored.
Does Thermal Really Always Matter for RGB-T Salient Object Detection?
In addition, considering the role of thermal modality, we set up different cross-modality interaction mechanisms in the encoding phase and the decoding phase.
Deep Manifold Hashing: A Divide-and-Conquer Approach for Semi-Paired Unsupervised Cross-Modal Retrieval
Hashing that projects data into binary codes has shown extraordinary talents in cross-modal retrieval due to its low storage usage and high query speed.
Multi-modal Segment Assemblage Network for Ad Video Editing with Importance-Coherence Reward
The existing method performs well at video segmentation stages but suffers from the problems of dependencies on extra cumbersome models and poor performance at the segment assemblage stage.
Pose-Aided Video-based Person Re-Identification via Recurrent Graph Convolutional Network
Finally, we propose a dual-attention method consisting of node-attention and time-attention to obtain the temporal graph representation from the node embeddings, where the self-attention mechanism is employed to learn the importance of each node and each frame.
T-Person-GAN: Text-to-Person Image Generation with Identity-Consistency and Manifold Mix-Up
Our architecture is orthogonal to StackGAN++ , and focuses on person image generation, with all of them together to enrich the spectrum of GANs for the image generation task.
Spatial-Temporal Pyramid Graph Reasoning for Action Recognition
Spatial-temporal relation reasoning is a significant yet challenging problem for video action recognition.
Ranked #29 on
Action Recognition
on Something-Something V1
S$^2$Contact: Graph-based Network for 3D Hand-Object Contact Estimation with Semi-Supervised Learning
In this paper, we propose a novel semi-supervised framework that allows us to learn contact from monocular images.
Prompting for Multi-Modal Tracking
Multi-modal tracking gains attention due to its ability to be more accurate and robust in complex scenarios compared to traditional RGB-based tracking.
Exploiting Context Information for Generic Event Boundary Captioning
Previous methods only process the information of a single boundary at a time, which lacks utilization of video context information.
VLMixer: Unpaired Vision-Language Pre-training via Cross-Modal CutMix
Existing vision-language pre-training (VLP) methods primarily rely on paired image-text datasets, which are either annotated by enormous human labors, or crawled from the internet followed by elaborate data cleaning techniques.
VITA: A Multi-Source Vicinal Transfer Augmentation Method for Out-of-Distribution Generalization
The tangent transfer creates initial augmented samples for improving corruption robustness.
Semantic-Aware Pretraining for Dense Video Captioning
This report describes the details of our approach for the event dense-captioning task in ActivityNet Challenge 2021.
RGBD Object Tracking: An In-depth Review
Particularly, we are the first to provide depth quality evaluation and analysis of tracking results in depth-friendly scenarios in RGBD tracking.
Unified Multivariate Gaussian Mixture for Efficient Neural Image Compression
Modeling latent variables with priors and hyperpriors is an essential problem in variational image compression.
Error-based Knockoffs Inference for Controlled Feature Selection
Recently, the scheme of model-X knockoffs was proposed as a promising solution to address controlled feature selection under high-dimensional finite-sample settings.
Skating-Mixer: Long-Term Sport Audio-Visual Modeling with MLPs
Figure skating scoring is challenging because it requires judging the technical moves of the players as well as their coordination with the background music.
Class-Aware Contrastive Semi-Supervised Learning
Pseudo-label-based semi-supervised learning (SSL) has achieved great success on raw data utilization.
Cross-Modality Neuroimage Synthesis: A Survey
In this paper, we are the first one to comprehensively approach cross-modality neuroimage synthesis task from different perspectives, which include the level of the supervision (especially for weakly-supervised and unsupervised), loss function, evaluation metrics, the range of modality synthesis, datasets (aligned, private and public) and the synthesis-based downstream tasks.
A Survey of Visual Sensory Anomaly Detection
In this survey, we are the first one to provide a comprehensive review of visual sensory AD and category into three levels according to the form of anomalies.
FedMed-ATL: Misaligned Unpaired Brain Image Synthesis via Affine Transform Loss
The proposed method demonstrates the advanced performance in both the quality of our synthesized results under a severely misaligned and unpaired data setting, and better stability than other GAN-based algorithms.
FedMed-GAN: Federated Domain Translation on Unsupervised Cross-Modality Brain Image Synthesis
There is a clear need to launch a federated learning and facilitate the integration of the dispersed data from different institutions.
Meta Distribution Alignment for Generalizable Person Re-Identification
Domain Generalizable (DG) person ReID is a challenging task which trains a model on source domains yet generalizes well on target domains.
Domain Generalization
Generalizable Person Re-identification
+1
GuidedMix-Net: Semi-supervised Semantic Segmentation by Using Labeled Images as Reference
In this paper, we propose a novel method for semi-supervised semantic segmentation named GuidedMix-Net, by leveraging labeled information to guide the learning of unlabeled instances.
Benchmarks for Corruption Invariant Person Re-identification
When deploying person re-identification (ReID) model in safety-critical applications, it is pivotal to understanding the robustness of the model against a diverse array of image corruptions.
Ranked #1 on
Cross-Modal Person Re-Identification
on RegDB-C
(mINP (Visible to Thermal) metric)
Cross-Modal Person Re-Identification
Generalizable Person Re-identification
DepthTrack : Unveiling the Power of RGBD Tracking
RGBD (RGB plus depth) object tracking is gaining momentum as RGBD sensors have become popular in many application fields such as robotics. However, the best RGBD trackers are extensions of the state-of-the-art deep RGB trackers.
Seminar Learning for Click-Level Weakly Supervised Semantic Segmentation
Annotation burden has become one of the biggest barriers to semantic segmentation.
Weakly supervised Semantic Segmentation
Weakly-Supervised Semantic Segmentation
End-to-End Dense Video Captioning with Parallel Decoding
Dense video captioning aims to generate multiple associated captions with their temporal locations from the video.
Ranked #2 on
Dense Video Captioning
on YouCook2
An Information-theoretic Perspective of Hierarchical Clustering
In this paper, we investigate hierarchical clustering from the \emph{information-theoretic} perspective and formulate a new objective function.
Saliency-Associated Object Tracking
A potential limitation of such trackers is that not all patches are equally informative for tracking.
FREE: Feature Refinement for Generalized Zero-Shot Learning
FREE employs a feature refinement (FR) module that incorporates \textit{semantic$\rightarrow$visual} mapping into a unified generative model to refine the visual features of seen and unseen class samples.
WeClick: Weakly-Supervised Video Semantic Segmentation with Click Annotations
In this work, we propose an effective weakly-supervised video semantic segmentation pipeline with click annotations, called WeClick, for saving laborious annotating effort by segmenting an instance of the semantic class with only a single click.
GuidedMix-Net: Learning to Improve Pseudo Masks Using Labeled Images as Reference
To take advantage of the labeled examples and guide unlabeled data learning, we further propose a mask generation module to generate high-quality pseudo masks for the unlabeled data.
Brain Image Synthesis With Unsupervised Multivariate Canonical CSCl4Net
Recent advances in neuroscience have highlighted the effectiveness of multi-modal medical data for investigating certain pathologies and understanding human cognition.
Learning 3D Shape Feature for Texture-Insensitive Person Re-Identification
In this paper, rather than relying on texture based information, we propose to improve the robustness of person ReID against clothing texture by exploiting the information of a person's 3D shape.
Ranked #4 on
Person Re-Identification
on PRCC
Brain Image Synthesis with Unsupervised Multivariate Canonical CSC$\ell_4$Net
Recent advances in neuroscience have highlighted the effectiveness of multi-modal medical data for investigating certain pathologies and understanding human cognition.
Tiny Adversarial Mulit-Objective Oneshot Neural Architecture Search
Our work focuses on how to improve the robustness of tiny neural networks without seriously deteriorating of clean accuracy under mobile-level resources.
A Bayesian Federated Learning Framework with Online Laplace Approximation
On the client side, a prior loss that uses the global posterior probabilistic parameters delivered from the server is designed to guide the local training.
Contextual Non-Local Alignment over Full-Scale Representation for Text-Based Person Search
Secondly, a BERT with locality-constrained attention is proposed to obtain representations of descriptions at different scales.
Ranked #8 on
Text based Person Retrieval
on CUHK-PEDES
DepthTrack: Unveiling the Power of RGBD Tracking
This can be explained by the fact that there are no sufficiently large RGBD datasets to 1) train "deep depth trackers" and to 2) challenge RGB trackers with sequences for which the depth cue is essential.
One for More: Selecting Generalizable Samples for Generalizable ReID Model
Current training objectives of existing person Re-IDentification (ReID) models only ensure that the loss of the model decreases on selected training batch, with no regards to the performance on samples outside the batch.
Multi-task Additive Models for Robust Estimation and Automatic Structure Discovery
For high-dimensional observations in real environment, e. g., Coronal Mass Ejections (CMEs) data, the learning performance of previous methods may be degraded seriously due to the complex non-Gaussian noise and the insufficiency of prior knowledge on variable structure.
A Parallel Down-Up Fusion Network for Salient Object Detection in Optical Remote Sensing Images
In this paper, we propose a novel Parallel Down-up Fusion network (PDF-Net) for SOD in optical RSIs, which takes full advantage of the in-path low- and high-level features and cross-path multi-resolution features to distinguish diversely scaled salient objects and suppress the cluttered backgrounds.
Devil's in the Details: Aligning Visual Clues for Conditional Embedding in Person Re-Identification
Secondly, the Conditional Feature Embedding requires the overall feature of a query image to be dynamically adjusted based on the gallery image it matches, while most of the existing methods ignore the reference images.
Ranked #1 on
Person Re-Identification
on CUHK03-C
LSOTB-TIR:A Large-Scale High-Diversity Thermal Infrared Object Tracking Benchmark
We evaluate and analyze more than 30 trackers on LSOTB-TIR to provide a series of baselines, and the results show that deep trackers achieve promising performance.
Dual Distribution Alignment Network for Generalizable Person Re-Identification
Domain generalization (DG) serves as a promising solution to handle person Re-Identification (Re-ID), which trains the model using labels from the source domain alone, and then directly adopts the trained model to the target domain without model updating.
Domain Generalization
Generalizable Person Re-identification
3dDepthNet: Point Cloud Guided Depth Completion Network for Sparse Depth and Single Color Image
In this paper, we propose an end-to-end deep learning network named 3dDepthNet, which produces an accurate dense depth image from a single pair of sparse LiDAR depth and color image for robotics and autonomous driving tasks.
Viewpoint-Aware Loss with Angular Regularization for Person Re-Identification
Instead of one subspace for each viewpoint, our method projects the feature from different viewpoints into a unified hypersphere and effectively models the feature distribution on both the identity-level and the viewpoint-level.
Ranked #5 on
Person Re-Identification
on Market-1501
(using extra training data)
Rethinking Temporal Fusion for Video-based Person Re-identification on Semantic and Time Aspect
Recently, the research interest of person re-identification (ReID) has gradually turned to video-based methods, which acquire a person representation by aggregating frame features of an entire video.
Supervised Online Hashing via Similarity Distribution Learning
In this paper, we propose to model the similarity distributions between the input data and the hashing codes, upon which a novel supervised online hashing method, dubbed as Similarity Distribution based Online Hashing (SDOH), is proposed, to keep the intrinsic semantic relationship in the produced Hamming space.
Deep Spectral Clustering using Dual Autoencoder Network
In this paper, we propose a joint learning framework for discriminative embedding and spectral clustering.
Pyramidal Person Re-IDentification via Multi-Loss Dynamic Training
Most existing Re-IDentification (Re-ID) methods are highly dependent on precise bounding boxes that enable images to be aligned with each other.
Ranked #2 on
Person Re-Identification
on CUHK03-C
Unsupervised Deep Generative Adversarial Hashing Network
HashGAN consists of three networks, a generator, a discriminator and an encoder.
Trifo-VIO: Robust and Efficient Stereo Visual Inertial Odometry using Points and Lines
In this paper, we present the Trifo Visual Inertial Odometry (Trifo-VIO), a tightly-coupled filtering-based stereo VIO system using both points and lines.
PIRVS: An Advanced Visual-Inertial SLAM System with Flexible Sensor Fusion and Hardware Co-Design
In this paper, we present the PerceptIn Robotics Vision System (PIRVS) system, a visual-inertial computing hardware with embedded simultaneous localization and mapping (SLAM) algorithm.
Dual-reference Face Retrieval
Face retrieval has received much attention over the past few decades, and many efforts have been made in retrieving face images against pose, illumination, and expression variations.
