Search Results for author:
Found 62 papers, 34 papers with code
Geometric Estimation via Robust Subspace Recovery
Geometric estimation from image point correspondences is the core procedure of many 3D vision problems, which is prevalently accomplished by random sampling techniques.
CoMatch: Dynamic Covisibility-Aware Transformer for Bilateral Subpixel-Level Semi-Dense Image Matching
This prospective study proposes CoMatch, a novel semi-dense image matcher with dynamic covisibility awareness and bilateral subpixel accuracy.
DSPFusion: Image Fusion via Degradation and Semantic Dual-Prior Guidance
This work presents a \textbf{D}egradation and \textbf{S}emantic \textbf{P}rior dual-guided framework for degraded image \textbf{Fusion} (\textbf{DSPFusion}), utilizing degradation priors and high-quality scene semantic priors restored via diffusion models to guide both information recovery and fusion in a unified model.
ControlFusion: A Controllable Image Fusion Framework with Language-Vision Degradation Prompts
Current image fusion methods struggle to address the composite degradations encountered in real-world imaging scenarios and lack the flexibility to accommodate user-specific requirements.
VideoFusion: A Spatio-Temporal Collaborative Network for Mutli-modal Video Fusion and Restoration
Compared to images, videos better align with real-world acquisition scenarios and possess valuable temporal cues.
Selecting and Pruning: A Differentiable Causal Sequentialized State-Space Model for Two-View Correspondence Learning
Two-view correspondence learning aims to discern true and false correspondences between image pairs by recognizing their underlying different information.
MEET: A Million-Scale Dataset for Fine-Grained Geospatial Scene Classification with Zoom-Free Remote Sensing Imagery
To address this limitation, we introduce the Million-scale finE-grained geospatial scEne classification dataseT (MEET), which contains over 1. 03 million zoom-free remote sensing scene samples, manually annotated into 80 fine-grained categories.
SpecDM: Hyperspectral Dataset Synthesis with Pixel-level Semantic Annotations
We select two of the most widely used dense prediction tasks: semantic segmentation and change detection, and generate datasets suitable for these tasks.
Text-DiFuse: An Interactive Multi-Modal Image Fusion Framework based on Text-modulated Diffusion Model
Second, by embedding the combination of the text and zero-shot location model into the diffusion fusion process, a text-controlled fusion re-modulation strategy is developed.
Fusion from Decomposition: A Self-Supervised Approach for Image Fusion and Beyond
To address these limitations, we introduce DeFusion++, a novel framework that leverages self-supervised learning (SSL) to enhance the versatility of feature representation for different image fusion tasks.
Aux-NAS: Exploiting Auxiliary Labels with Negligibly Extra Inference Cost
We aim at exploiting additional auxiliary labels from an independent (auxiliary) task to boost the primary task performance which we focus on, while preserving a single task inference cost of the primary task.
MaeFuse: Transferring Omni Features with Pretrained Masked Autoencoders for Infrared and Visible Image Fusion via Guided Training
Instead of being driven by downstream tasks, our model utilizes a pretrained encoder from Masked Autoencoders (MAE), which facilities the omni features extraction for low-level reconstruction and high-level vision tasks, to obtain perception friendly features with a low cost.
Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusion
Through the text semantic encoder and semantic interaction fusion decoder, Text-IF is accessible to the all-in-one infrared and visible image degradation-aware processing and the interactive flexible fusion outcomes.
Modeling the Label Distributions for Weakly-Supervised Semantic Segmentation
Based on the label distributions, we leverage the GMM to generate high-quality pseudo labels for more reliable supervision.
Weakly supervised Semantic Segmentation
Weakly-Supervised Semantic Segmentation
Latent Semantic Consensus For Deterministic Geometric Model Fitting
The principle of LSC is to preserve the latent semantic consensus in both data points and model hypotheses.
3D Lane Detection from Front or Surround-View using Joint-Modeling & Matching
Therefore, accurate lane modeling is essential to align prediction results closely with the environment.
Dispel Darkness for Better Fusion: A Controllable Visual Enhancer based on Cross-modal Conditional Adversarial Learning
The GRM utilizes the light-invariant high-contrast characteristics of the infrared modality as the central target distribution and constructs a multi-level conditional adversarial sample set to enable continuous controlled brightness enhancement of visible images.
Unmixing Before Fusion: A Generalized Paradigm for Multi-Source-based Hyperspectral Image Synthesis
By integrating unmixing this work maps unpaired HSI and RGB data to a low-dimensional abundance space greatly alleviating the difficulty of generating high-dimensional samples.
DeMatch: Deep Decomposition of Motion Field for Two-View Correspondence Learning
Specifically we first decompose the rough motion field that is contaminated by false matches into several different sub-fields which are highly smooth and contain the main energy of the original field.
MRFS: Mutually Reinforcing Image Fusion and Segmentation
Then the cascade of IGM-Att and PC-Att couples image fusion and semantic segmentation tasks implicitly bringing vision-related and semantics-related features into closer alignment.
Word length-aware text spotting: Enhancing detection and recognition in dense text image
Scene text spotting is essential in various computer vision applications, enabling extracting and interpreting textual information from images.
Diff-Retinex: Rethinking Low-light Image Enhancement with A Generative Diffusion Model
Therefore, Diff-Retinex formulates the low-light image enhancement problem into Retinex decomposition and conditional image generation.
ResMatch: Residual Attention Learning for Local Feature Matching
In order to facilitate the learning of matching and filtering, we inject the similarity of descriptors and relative positions into cross- and self-attention score, respectively.
Learning Feature Matching via Matchable Keypoint-Assisted Graph Neural Network
Then, our Matchable Keypoint-Assisted Context Aggregation Module regards sampled informative keypoints as message bottlenecks and thus constrains each keypoint only to retrieve favorable contextual information from intra- and inter- matchable keypoints, evading the interference of irrelevant and redundant connectivity with non-repeatable ones.
Image Deblurring by Exploring In-depth Properties of Transformer
We demonstrate the effectiveness of transformer properties in improving the perceptual quality while not sacrificing the quantitative scores (PSNR) over the most competitive models, such as Uformer, Restormer, and NAFNet, on defocus deblurring and motion deblurring tasks.
Dif-Fusion: Towards High Color Fidelity in Infrared and Visible Image Fusion with Diffusion Models
In specific, instead of converting multi-channel images into single-channel data in existing fusion methods, we create the multi-channel data distribution with a denoising network in a latent space with forward and reverse diffusion process.
LSTFE-Net:Long Short-Term Feature Enhancement Network for Video Small Object Detection
We find that context information from the long-term frame and temporal information from the short-term frame are two useful cues for video small object detection.
Sparsely Annotated Semantic Segmentation With Adaptive Gaussian Mixtures
Our AGMM can effectively endow reliable supervision for unlabeled pixels based on the distributions of labeled and unlabeled pixels.
Progressive Learning with Cross-Window Consistency for Semi-Supervised Semantic Segmentation
Semi-supervised semantic segmentation focuses on the exploration of a small amount of labeled data and a large amount of unlabeled data, which is more in line with the demands of real-world image understanding applications.
ReDFeat: Recoupling Detection and Description for Multimodal Feature Learning
Deep-learning-based local feature extraction algorithms that combine detection and description have made significant progress in visible image matching.
Hierarchical Memory Learning for Fine-Grained Scene Graph Generation
After the autonomous partition of coarse and fine predicates, the model is first trained on the coarse predicates and then learns the fine predicates.
RFNet: Unsupervised Network for Mutually Reinforcing Multi-Modal Image Registration and Fusion
Specifically, for image registration, we solve the bottlenecks of defining registration metrics applicable for multi-modal images and facilitating the network convergence.
Coherent Point Drift Revisited for Non-Rigid Shape Matching and Registration
In this paper, we explore a new type of extrinsic method to directly align two geometric shapes with point-to-point correspondences in ambient space by recovering a deformation, which allows more continuous and smooth maps to be obtained.
MS2DG-Net: Progressive Correspondence Learning via Multiple Sparse Semantics Dynamic Graph
However, most such works ignore similar sparse semantics information between two given images and cannot capture local topology among correspondences well.
Learning A 3D-CNN and Transformer Prior for Hyperspectral Image Super-Resolution
Learning-based methods usually use a convolutional neural network (CNN) to learn the implicit priors of HSIs.
TANet: A new Paradigm for Global Face Super-resolution via Transformer-CNN Aggregation Network
Recently, face super-resolution (FSR) methods either feed whole face image into convolutional neural networks (CNNs) or utilize extra facial priors (e. g., facial parsing maps, facial landmarks) to focus on facial structure, thereby maintaining the consistency of the facial structure while restoring facial details.
From Less to More: Spectral Splitting and Aggregation Network for Hyperspectral Face Super-Resolution
By this spectral splitting and aggregation strategy (SSAS), we can divide the original hyperspectral image into multiple samples (\emph{from less to more}) to support the efficient training of the network and effectively exploit the spectral correlations among spectrum.
Uniformity in Heterogeneity:Diving Deep into Count Interval Partition for Crowd Counting
Therefore, we propose a novel count interval partition criterion called Uniform Error Partition (UEP), which always keeps the expected counting error contributions equal for all intervals to minimize the prediction risk.
SDGMNet: Statistic-based Dynamic Gradient Modulation for Local Descriptor Learning
Modifications on triplet loss that rescale the back-propagated gradients of special pairs have made significant progress on local descriptor learning.
BaMBNet: A Blur-aware Multi-branch Network for Defocus Deblurring
In particular, we estimate the blur amounts of different regions by the internal geometric constraint of the DP data, which measures the defocus disparity between the left and right views.
Ranked #7 on
Image Defocus Deblurring
on DPD (Dual-view)
Pan-sharpening via High-pass Modification Convolutional Neural Network
Most existing deep learning-based pan-sharpening methods have several widely recognized issues, such as spectral distortion and insufficient spatial texture enhancement, we propose a novel pan-sharpening convolutional neural network based on a high-pass modification block.
Omniscient Video Super-Resolution
Most recent video super-resolution (SR) methods either adopt an iterative manner to deal with low-resolution (LR) frames from a temporally sliding window, or leverage the previously estimated SR output to help reconstruct the current frame recurrently.
Bilateral attention decoder: A lightweight decoder for real-time semantic segmentation
To verify the efficiency of the proposed bilateral attention decoder, we adopt a lightweight network as the backbone and compare our proposed method with other state-of-the-art real-time semantic segmentation methods on the Cityscapes and Camvid datasets.
Deep Learning-based Face Super-Resolution: A Survey
Second, we elaborate on the facial characteristics and popular datasets used in FSR.
T-Net: Effective Permutation-Equivariant Network for Two-View Correspondence Learning
We develop a conceptually simple, flexible, and effective framework (named T-Net) for two-view correspondence learning.
Uniformity in Heterogeneity: Diving Deep Into Count Interval Partition for Crowd Counting
Therefore, we propose a novel count interval partition criterion called Uniform Error Partition (UEP), which always keeps the expected counting error contributions equal for all intervals to minimize the prediction risk.
Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery
Recently, single gray/RGB image super-resolution reconstruction task has been extensively studied and made significant progress by leveraging the advanced machine learning techniques based on deep convolutional neural networks (DCNNs).
MTL-NAS: Task-Agnostic Neural Architecture Search towards General-Purpose Multi-Task Learning
We propose to incorporate neural architecture search (NAS) into general-purpose multi-task learning (GP-MTL).
Multi-Scale Progressive Fusion Network for Single Image Deraining
In this work, we explore the multi-scale collaborative representation for rain streaks from the perspective of input image scales and hierarchical deep features in a unified framework, termed multi-scale progressive fusion network (MSPFN) for single image rain streak removal.
Ranked #6 on
Single Image Deraining
on Test2800
LaFIn: Generative Landmark Guided Face Inpainting
It is challenging to inpaint face images in the wild, due to the large variation of appearance, such as different poses, expressions and occlusions.
EDIT: Exemplar-Domain Aware Image-to-Image Translation
The principle behind is that, for images from multiple domains, the content features can be obtained by a uniform extractor, while (re-)stylization is achieved by mapping the extracted features specifically to different purposes (domains and exemplars).
Generative Adversarial Network
Image-to-Image Translation
+1
Ensemble Super-Resolution with A Reference Dataset
In this paper, we present a simple but effective single image SR method based on ensemble learning, which can produce a better performance than that could be obtained from any of SR methods to be ensembled (or called component super-resolvers).
PFLD: A Practical Facial Landmark Detector
Being accurate, efficient, and compact is essential to a facial landmark detector for practical use.
Hyperspectral Image Classification in the Presence of Noisy Labels
The key idea of RLPA is to exploit knowledge (e. g., the superpixel based spectral-spatial constraints) from the observed hyperspectral images and apply it to the process of label propagation.
Context-Patch Face Hallucination Based on Thresholding Locality-constrained Representation and Reproducing Learning
To this end, this study incorporates the contextual information of image patch and proposes a powerful and efficient context-patch based face hallucination approach, namely Thresholding Locality-constrained Representation and Reproducing learning (TLcR-RL).
Deep CNN Denoiser and Multi-layer Neighbor Component Embedding for Face Hallucination
Most of the current face hallucination methods, whether they are shallow learning-based or deep learning-based, all try to learn a relationship model between Low-Resolution (LR) and High-Resolution (HR) spaces with the help of a training set.
SuperPCA: A Superpixelwise PCA Approach for Unsupervised Feature Extraction of Hyperspectral Imagery
(1) Unlike the traditional PCA method based on a whole image, SuperPCA takes into account the diversity in different homogeneous regions, that is, different regions should have different projections.
NDDR-CNN: Layerwise Feature Fusing in Multi-Task CNNs by Neural Discriminative Dimensionality Reduction
In this paper, we propose a novel Convolutional Neural Network (CNN) structure for general-purpose multi-task learning (MTL), which enables automatic feature fusing at every layer from different tasks.
Ranked #100 on
Semantic Segmentation
on NYU Depth v2
Semi-Supervised Sparse Representation Based Classification for Face Recognition with Insufficient Labeled Samples
This is based on recent work on sparsity where faces are represented in terms of two dictionaries: a gallery dictionary consisting of one or more examples of each person, and a variation dictionary representing linear nuisance variables (e. g., different lighting conditions, different glasses).
Density-Based Region Search with Arbitrary Shape for Object Localization
Typically, the region search methods project the score of a classifier into an image plane, and then search the region with the maximal score.
Robust Estimation of Nonrigid Transformation for Point Set Registration
In the second step, we estimate the transformation using a robust estimator called L 2 E. This is the main novelty of our approach and it enables us to deal with the noise and outliers which arise in the correspondence step.
