Search Results for author:
Found 62 papers, 31 papers with code
Parameter-Free Style Projection for Arbitrary Style Transfer
This paper further presents a real-time feed-forward model to leverage Style Projection for arbitrary image style transfer, which includes a regularization term for matching the semantics between input contents and stylized outputs.
Denoising Diffusion Models for Plug-and-Play Image Restoration
Although diffusion models have shown impressive performance for high-quality image synthesis, their potential to serve as a generative denoiser prior to the plug-and-play IR methods remains to be further explored.
Non-Local Recurrent Network for Image Restoration
The main contributions of this work are: (1) Unlike existing methods that measure self-similarity in an isolated manner, the proposed non-local module can be flexibly integrated into existing deep networks for end-to-end training to capture deep feature correlation between each location and its neighborhood.
Ranked #1 on
Grayscale Image Denoising
on Set12 sigma30
SinSR: Diffusion-Based Image Super-Resolution in a Single Step
Extensive experiments conducted on synthetic and real-world datasets demonstrate that the proposed method can achieve comparable or even superior performance compared to both previous SOTA methods and the teacher model, in just one sampling step, resulting in a remarkable up to x10 speedup for inference.
ShadowFormer: Global Context Helps Image Shadow Removal
It is still challenging for the deep shadow removal model to exploit the global contextual correlation between shadow and non-shadow regions.
Ranked #1 on
Shadow Removal
on ISTD
ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removal
Recent deep learning methods have achieved promising results in image shadow removal.
When Image Denoising Meets High-Level Vision Tasks: A Deep Learning Approach
Conventionally, image denoising and high-level vision tasks are handled separately in computer vision.
Connecting Image Denoising and High-Level Vision Tasks via Deep Learning
Second we propose a deep neural network solution that cascades two modules for image denoising and various high-level tasks, respectively, and use the joint loss for updating only the denoising network via back-propagation.
ExposureDiffusion: Learning to Expose for Low-light Image Enhancement
Different from a vanilla diffusion model that has to perform Gaussian denoising, with the injected physics-based exposure model, our restoration process can directly start from a noisy image instead of pure noise.
Ranked #1 on
Image Denoising
on Image Denoising on SID x300
Generating Person Images with Appearance-aware Pose Stylizer
Generation of high-quality person images is challenging, due to the sophisticated entanglements among image factors, e. g., appearance, pose, foreground, background, local details, global structures, etc.
ReLLIE: Deep Reinforcement Learning for Customized Low-Light Image Enhancement
Low-light image enhancement (LLIE) is a pervasive yet challenging problem, since: 1) low-light measurements may vary due to different imaging conditions in practice; 2) images can be enlightened subjectively according to diverse preferences by each individual.
Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptation
Diffusion models have proven to be highly effective in image and video generation; however, they still face composition challenges when generating images of varying sizes due to single-scale training data.
Segmentation-Aware Image Denoising without Knowing True Segmentation
Several recent works discussed application-driven image restoration neural networks, which are capable of not only removing noise in images but also preserving their semantic-aware details, making them suitable for various high-level computer vision tasks as the pre-processing step.
Making Your First Choice: To Address Cold Start Problem in Vision Active Learning
However, we uncover a striking contradiction to this promise: active learning fails to select data as efficiently as random selection at the first few choices.
Variational Disentanglement for Domain Generalization
Domain generalization aims to learn an invariant model that can generalize well to the unseen target domain.
From Rank Estimation to Rank Approximation: Rank Residual Constraint for Image Restoration
Towards this end, we first obtain a good reference of the original image groups by using the image NSS prior, and then the rank residual of the image groups between this reference and the degraded image is minimized to achieve a better estimate to the desired image.
Joint Adaptive Sparsity and Low-Rankness on the Fly: An Online Tensor Reconstruction Scheme for Video Denoising
In this work, we propose a novel video denoising method, based on an online tensor reconstruction scheme with a joint adaptive sparse and low-rank model, dubbed SALT.
Exploiting Non-Local Priors via Self-Convolution For Highly-Efficient Image Restoration
Experimental results demonstrate that (1) Self-Convolution can significantly speed up most of the popular non-local image restoration algorithms, with two-fold to nine-fold faster block matching, and (2) the proposed multi-modality image restoration scheme achieves superior denoising results in both efficiency and effectiveness on RGB-NIR images.
Learning to Solve Multiple-TSP with Time Window and Rejections via Deep Reinforcement Learning
We propose a manager-worker framework based on deep reinforcement learning to tackle a hard yet nontrivial variant of Travelling Salesman Problem (TSP), \ie~multiple-vehicle TSP with time window and rejections (mTSPTWR), where customers who cannot be served before the deadline are subject to rejections.
Raw Image Reconstruction with Learned Compact Metadata
While raw images exhibit advantages over sRGB images (e. g., linearity and fine-grained quantization level), they are not widely used by common users due to the large storage requirements.
Beyond Learned Metadata-based Raw Image Reconstruction
Besides, we propose a novel design of the context model, which can better predict the order masks of encoding/decoding based on both the sRGB image and the masks of already processed features.
sRGB Real Noise Synthesizing With Neighboring Correlation-Aware Noise Model
Modeling and synthesizing real noise in the standard RGB (sRGB) domain is challenging due to the complicated noise distribution.
Disentangled Feature Representation for Few-shot Image Classification
In this work, we propose a novel Disentangled Feature Representation framework, dubbed DFR, for few-shot learning applications.
Progressive Divide-and-Conquer via Subsampling Decomposition for Accelerated MRI
Starting from decomposing the original maximum-a-posteriori problem of accelerated MRI, we present a rigorous derivation of the proposed PDAC framework, which could be further unfolded into an end-to-end trainable network.
Removing Image Artifacts From Scratched Lens Protectors
Removing image artifacts from the scratched lens protector is inherently challenging due to the occasional flare artifacts and the co-occurring interference within mixed artifacts.
VIDOSAT: High-dimensional Sparsifying Transform Learning for Online Video Denoising
Transform learning methods involve cheap computations and have been demonstrated to perform well in applications such as image denoising and medical image reconstruction.
WBCAtt: A White Blood Cell Dataset Annotated with Detailed Morphological Attributes
We then annotated ten thousand WBC images with these attributes.
Learning Nonlocal Sparse and Low-Rank Models for Image Compressive Sensing
Furthermore, we present a unified framework for incorporating various GSR and LR models and discuss the relationship between GSR and LR models.
Reconciliation of Statistical and Spatial Sparsity For Robust Image and Image-Set Classification
Recent image classification algorithms, by learning deep features from large-scale datasets, have achieved significantly better results comparing to the classic feature-based approaches.
Benchmarking White Blood Cell Classification Under Domain Shift
Recognizing the types of white blood cells (WBCs) in microscopic images of human blood smears is a fundamental task in the fields of pathology and hematology.
A Benchmark for Sparse Coding: When Group Sparsity Meets Rank Minimization
Sparse coding has achieved a great success in various image processing tasks.
FRIST - Flipping and Rotation Invariant Sparsifying Transform Learning and Applications
Features based on sparse representation, especially using the synthesis dictionary model, have been heavily exploited in signal processing and computer vision.
A Comparative Study for the Nuclear Norms Minimization Methods
Inspired by enhancing sparsity of the weighted L1-norm minimization in comparison with L1-norm minimization in sparse representation, we thus explain that WNNM is more effective than NMM.
Machine Learning Techniques and Applications For Ground-based Image Analysis
Ground-based whole sky cameras have opened up new opportunities for monitoring the earth's atmosphere.
The Power of Complementary Regularizers: Image Recovery via Transform Learning and Low-Rank Modeling
Recent works on adaptive sparse and on low-rank signal modeling have demonstrated their usefulness in various image / video processing applications.
Transform Learning for Magnetic Resonance Image Reconstruction: From Model-based Learning to Building Neural Networks
The model could be pre-learned from datasets, or learned simultaneously with the reconstruction, i. e., blind CS (BCS).
A Set-Theoretic Study of the Relationships of Image Models and Priors for Restoration Problems
Furthermore, we relate the denoising performance improvement by combining multiple models, to the image model relationships.
The Power of Triply Complementary Priors for Image Compressive Sensing
In this paper, we propose a joint low-rank and deep (LRD) image model, which contains a pair of triply complementary priors, namely \textit{external} and \textit{internal}, \textit{deep} and \textit{shallow}, and \textit{local} and \textit{non-local} priors.
Hyper RPCA: Joint Maximum Correntropy Criterion and Laplacian Scale Mixture Modeling On-the-Fly for Moving Object Detection
Robust Principal Component Analysis (RPCA), as one of the most popular moving object modelling methods, aims to separate the temporally varying (i. e., moving) foreground objects from the static background in video, assuming the background frames to be low-rank while the foreground to be spatially sparse.
Attentive Graph Neural Networks for Few-Shot Learning
Graph Neural Networks (GNN) has demonstrated the superior performance in many challenging applications, including the few-shot learning tasks.
Robust Single Image Super-Resolution via Deep Networks With Sparse Prior
We demonstrate that a sparse coding model particularly designed for SR can be incarnated as a neural network with the merit of end-to-end optimization over training data.
Removing Backdoor-Based Watermarks in Neural Networks with Limited Data
In this paper, we benchmark the robustness of watermarking, and propose a novel backdoor-based watermark removal framework using limited data, dubbed WILD.
Feature Distillation With Guided Adversarial Contrastive Learning
In this paper, we propose a novel approach called Guided Adversarial Contrastive Distillation (GACD), to effectively transfer adversarial robustness from teacher to student with features.
Joint Dimensionality Reduction for Separable Embedding Estimation
In this paper, we propose a supervised dimensionality reduction method that learns linear embeddings jointly for two feature vectors representing data of different modalities or data from distinct types of entities.
Recent Advances in Adversarial Training for Adversarial Robustness
Adversarial training is one of the most effective approaches defending against adversarial examples for deep learning models.
Systematic Analysis and Removal of Circular Artifacts for StyleGAN
StyleGAN is one of the state-of-the-art image generators which is well-known for synthesizing high-resolution and hyper-realistic face images.
R3L: Connecting Deep Reinforcement Learning to Recurrent Neural Networks for Image Denoising via Residual Recovery
To benchmark the effectiveness of reinforcement learning in R3L, we train a recurrent neural network with the same architecture for residual recovery using the deterministic loss, thus to analyze how the two different training strategies affect the denoising performance.
Ranked #1 on
Image Denoising
on BSD68 sigma30
PIP: Physical Interaction Prediction via Mental Simulation with Span Selection
However, there is a lack of intuitive physics models that are tested on long physical interaction sequences with multiple interactions among different objects.
Ranked #1 on
Semantic Object Interaction Classification
on SPACE
Adversarial Purification through Representation Disentanglement
Deep learning models are vulnerable to adversarial examples and make incomprehensible mistakes, which puts a threat on their real-world deployment.
FINO: Flow-based Joint Image and Noise Model
One of the fundamental challenges in image restoration is denoising, where the objective is to estimate the clean image from its noisy measurements.
Enhancing Low-Light Images in Real World via Cross-Image Disentanglement
Images captured in the low-light condition suffer from low visibility and various imaging artifacts, e. g., real noise.
ABCDE: An Agent-Based Cognitive Development Environment
How can the most common 1, 000 concepts (89\% of everyday use) be learnt in a naturalistic children's setting?
REPNP: Plug-and-Play with Deep Reinforcement Learning Prior for Robust Image Restoration
To this end, we propose a novel deep reinforcement learning (DRL) based PnP framework, dubbed RePNP, by leveraging a light-weight DRL-based denoiser for robust image restoration tasks.
Temporal Output Discrepancy for Loss Estimation-based Active Learning
Inspired by the fact that the samples with higher loss are usually more informative to the model than the samples with lower loss, in this paper we present a novel deep active learning approach that queries the oracle for data annotation when the unlabeled sample is believed to incorporate high loss.
Unsupervised Deep Digital Staining For Microscopic Cell Images Via Knowledge Distillation
In this work, we propose a novel unsupervised deep learning framework for the digital staining of cell images using knowledge distillation and generative adversarial networks (GANs).
Confidence Attention and Generalization Enhanced Distillation for Continuous Video Domain Adaptation
The second module compares the outputs of augmented data from the current model to the outputs of weakly augmented data from the source model, forming a novel consistency regularization on the model to alleviate the accumulation of prediction errors.
Towards Adversarially Robust Continual Learning
Recent studies show that models trained by continual learning can achieve the comparable performances as the standard supervised learning and the learning flexibility of continual learning models enables their wide applications in the real world.
Enhancing Low-Light Images Using Infrared-Encoded Images
In this work, we propose a novel approach to increase the visibility of images captured under low-light environments by removing the in-camera infrared (IR) cut-off filter, which allows for the capture of more photons and results in improved signal-to-noise ratio due to the inclusion of information from the IR spectrum.
Spectral Convergence of Simplicial Complex Signals
We recall the notion of a complexon as the limit of a simplicial complex sequence [1].
Frequency Guidance Matters in Few-Shot Learning
Few-shot classification aims to learn a discriminative feature representation to recognize unseen classes with few labeled support samples.
Boundary-Aware Divide and Conquer: A Diffusion-Based Solution for Unsupervised Shadow Removal
Recent deep learning methods have achieved superior results in shadow removal.
Benchmarking Adversarial Robustness of Image Shadow Removal with Shadow-adaptive Attacks
This is primarily due to the unique characteristic of spatially varying illumination within shadow images.
