1 code implementation • 12 Jun 2024 • Senyan Xu, Zhijing Sun, Jiaying Zhu, Yurui Zhu, Xueyang Fu, Zheng-Jun Zha
Coarse demosaicing network is designed to produce a preliminary high-quality estimate of the RGB image from the HybridEVS raw data while the pixel correction network enhances the performance of image restoration and mitigates the impact of defective pixels.
no code implementations • 29 May 2024 • Dong Li, Yidi Liu, Xueyang Fu, Senyan Xu, Zheng-Jun Zha
Specifically, in the spatial dimension Fourier space, we introduce the zigzag coding to scan the frequencies to rearrange the orders from low to high frequencies, thereby orderly correlating the connections between frequencies; in the channel dimension Fourier space with arranged orders of frequencies in axis, we can directly use Mamba to perform frequency correlation and improve the channel information representation.
1 code implementation • 11 May 2024 • Long Peng, Yang Cao, Renjing Pei, Wenbo Li, Jiaming Guo, Xueyang Fu, Yang Wang, Zheng-Jun Zha
These convolutions are integrated in parallel with a novel linear weighting mechanism to form an Adaptive Directional Gradient Convolution (DGConv), which adaptively weights and fuses the basic directional gradients to improve the gradient arrangement perception capability for both regular and irregular textures.
1 code implementation • 8 May 2024 • Yaqi Wu, Zhihao Fan, Xiaofeng Chu, Jimmy S. Ren, Xiaoming Li, Zongsheng Yue, Chongyi Li, Shangcheng Zhou, Ruicheng Feng, Yuekun Dai, Peiqing Yang, Chen Change Loy, Senyan Xu, Zhijing Sun, Jiaying Zhu, Yurui Zhu, Xueyang Fu, Zheng-Jun Zha, Jun Cao, Cheng Li, Shu Chen, Liang Ma, Shiyang Zhou, Haijin Zeng, Kai Feng, Yongyong Chen, Jingyong Su, Xianyu Guan, Hongyuan Yu, Cheng Wan, Jiamin Lin, Binnan Han, Yajun Zou, Zhuoyuan Wu, Yuan Huang, Yongsheng Yu, Daoan Zhang, Jizhe Li, Xuanwu Yin, Kunlong Zuo, Yunfan Lu, Yijie Xu, Wenzong Ma, Weiyu Guo, Hui Xiong, Wei Yu, Bingchun Luo, Sabari Nathan, Priya Kansal
The increasing demand for computational photography and imaging on mobile platforms has led to the widespread development and integration of advanced image sensors with novel algorithms in camera systems.
1 code implementation • CVPR 2024 • Jie Xiao, Xueyang Fu, Yurui Zhu, Dong Li, Jie Huang, Kai Zhu, Zheng-Jun Zha
The spatial non-uniformity and diverse patterns of shadow degradation conflict with the weight sharing manner of dominant models which may lead to an unsatisfactory compromise.
Ranked #2 on Shadow Removal on ISTD+
no code implementations • 12 Dec 2023 • Jie Xiao, Kai Zhu, Han Zhang, Zhiheng Liu, Yujun Shen, Yu Liu, Xueyang Fu, Zheng-Jun Zha
Consistency Models (CMs) have showed a promise in creating visual content efficiently and with high quality.
no code implementations • 8 Dec 2023 • Xi Wang, Xueyang Fu, Peng-Tao Jiang, Jie Huang, Mi Zhou, Bo Li, Zheng-Jun Zha
The former facilitates channel-dependent degradation removal operation, allowing the network to tailor responses to various adverse weather types; the latter, by integrating Fourier's global properties into channel-independent content features, enhances network capacity for consistent global content reconstruction.
1 code implementation • CVPR 2024 • Yurui Zhu, Xueyang Fu, Peng-Tao Jiang, Hao Zhang, Qibin Sun, Jinwei Chen, Zheng-Jun Zha, Bo Li
This research focuses on the issue of single-image reflection removal (SIRR) in real-world conditions, examining it from two angles: the collection pipeline of real reflection pairs and the perception of real reflection locations.
no code implementations • 23 Jan 2023 • Yiyang Shen, Mingqiang Wei, Yongzhen Wang, Xueyang Fu, Jing Qin
Recent diffusion models have exhibited great potential in generative modeling tasks.
no code implementations • CVPR 2023 • Kunyu Wang, Xueyang Fu, Yukun Huang, Chengzhi Cao, Gege Shi, Zheng-Jun Zha
This loss enables the network to concentrate on extracting domain-invariant spectrum and domain-specific spectrum, so as to achieve better disentangling results.
no code implementations • CVPR 2023 • Dong Li, Jiaying Zhu, Menglu Wang, Jiawei Liu, Xueyang Fu, Zheng-Jun Zha
In the second step, guided by the learnable edges, a region message passing controller is devised to weaken the message passing between the forged and authentic regions.
no code implementations • CVPR 2023 • Yurui Zhu, Tianyu Wang, Xueyang Fu, Xuanyu Yang, Xin Guo, Jifeng Dai, Yu Qiao, Xiaowei Hu
Inspired by this observation, we design an efficient unified framework with a two-stage training strategy to explore the weather-general and weather-specific features.
no code implementations • CVPR 2023 • Chengzhi Cao, Xueyang Fu, Hongjian Liu, Yukun Huang, Kunyu Wang, Jiebo Luo, Zheng-Jun Zha
Video-based person re-identification (Re-ID) is a prominent computer vision topic due to its wide range of video surveillance applications.
Representation Learning Video-Based Person Re-Identification
2 code implementations • AAAI 2022 • Yurui Zhu, Zeyu Xiao, Yanchi Fang, Xueyang Fu, Zhiwei Xiong, Zheng-Jun Zha
To address these issues, we first propose a new shadow illumination model for the shadow removal task.
no code implementations • CVPR 2022 • Jie Huang, Yajing Liu, Xueyang Fu, Man Zhou, Yang Wang, Feng Zhao, Zhiwei Xiong
However, the procedures of correcting underexposure and overexposure to normal exposures are much different from each other, leading to large discrepancies for the network in correcting multiple exposures, thus resulting in poor performance.
1 code implementation • CVPR 2022 • Gang Yang, Man Zhou, Keyu Yan, Aiping Liu, Xueyang Fu, Fan Wang
Pan-sharpening aims to obtain high-resolution multispectral (MS) images for remote sensing systems and deep learning-based methods have achieved remarkable success.
no code implementations • CVPR 2022 • Weiqi Zou, Yang Wang, Xueyang Fu, Yang Cao
It is based on our observation that deep degradation representations can be clustered by degradation characteristics (types of rain) while independent of image content.
2 code implementations • CVPR 2022 • Yurui Zhu, Jie Huang, Xueyang Fu, Feng Zhao, Qibin Sun, Zheng-Jun Zha
Shadow removal, which aims to restore the background in the shadow regions, is challenging due to the highly ill-posed nature.
Ranked #7 on Shadow Removal on ISTD+
no code implementations • CVPR 2022 • Man Zhou, Keyu Yan, Jie Huang, Zihe Yang, Xueyang Fu, Feng Zhao
Despite the remarkable progress, existing state-of-the-art Pan-sharpening methods don't explicitly enforce the complementary information learning between two modalities of PAN and MS images.
no code implementations • NeurIPS 2021 • Man Zhou, Zeyu Xiao, Xueyang Fu, Aiping Liu, Gang Yang, Zhiwei Xiong
Deep learning provides a new avenue for image restoration, which demands a delicate balance between fine-grained details and high-level contextualized information during recovering the latent clear image.
no code implementations • CVPR 2021 • Man Zhou, Jie Xiao, Yifan Chang, Xueyang Fu, Aiping Liu, Jinshan Pan, Zheng-Jun Zha
The proposed model is capable of achieving superior performance on both inhomogeneous and incremental datasets, and is promising for highly compact systems to gradually learn myriad regularities of the different types of rain streaks.
no code implementations • CVPR 2021 • Zeyu Xiao, Xueyang Fu, Jie Huang, Zhen Cheng, Zhiwei Xiong
In this paper, we aim to improve the performance of compact VSR networks without changing their original architectures, through a knowledge distillation approach that transfers knowledge from a complicated VSR network to a compact one.
1 code implementation • 1 Feb 2021 • Zhenqi Fu, Xueyang Fu, Yue Huang, Xinghao Ding
Our approach, termed Twice Mixing, is motivated by the observation that a mid-quality image can be generated by mixing a high-quality image with its low-quality version.
no code implementations • ICCV 2021 • Yukun Huang, Xueyang Fu, Zheng-Jun Zha
In unconstrained real-world surveillance scenarios, person re-identification (Re-ID) models usually suffer from different low-level perceptual variations, e. g., cross-resolution and insufficient lighting.
no code implementations • ICCV 2021 • Xueyang Fu, Xi Wang, Aiping Liu, Junwei Han, Zheng-Jun Zha
Specifically, we design a variational model to formulate the image de-blocking problem and propose two prior terms for the image content and gradient, respectively.
no code implementations • ICCV 2021 • Yao Li, Xueyang Fu, Zheng-Jun Zha
However, the real noisy images in practical are mostly of high resolution rather than the cropped small patches and the vanilla training strategies ignore the cross-patch contextual dependency in the whole image.
no code implementations • ICCV 2021 • Jie Xiao, Man Zhou, Xueyang Fu, Aiping Liu, Zheng-Jun Zha
Equipped with our NR algorithm, the deep model can be trained on a list of synthetic rainy datasets by overcoming catastrophic forgetting, making it a general-version de-raining network.
no code implementations • CVPR 2020 • Yukun Huang, Zheng-Jun Zha, Xueyang Fu, Richang Hong, Liang Li
Person re-identification (Re-ID) in real-world scenarios usually suffers from various degradation factors, e. g., low-resolution, weak illumination, blurring and adverse weather.
no code implementations • 3 Dec 2019 • Huangxing Lin, Weihong Zeng, Xinghao Ding, Xueyang Fu, Yue Huang, John Paisley
Using the new image pair, the denoising network learns to generate clean and high-quality images from noisy observations.
no code implementations • ICCV 2019 • Xueyang Fu, Zheng-Jun Zha, Feng Wu, Xinghao Ding, John Paisley
To effectively reduce JPEG compression artifacts, we propose a deep convolutional sparse coding (DCSC) network architecture.
no code implementations • CVPR 2019 • Xueyang Fu, Zihuang Lin, Yue Huang, Xinghao Ding
Then a more accurate spatial preservation based on local gradient constraints is incorporated into the objective to fully utilize spatial information contained in the PAN image.
no code implementations • 24 Nov 2018 • Huangxing Lin, Xueyang Fu, Changxing Jing, Xinghao Ding, Yue Huang
Existing methods for single images raindrop removal either have poor robustness or suffer from parameter burdens.
no code implementations • 21 Nov 2018 • Xueyang Fu, Qi Qi, Yue Huang, Xinghao Ding, Feng Wu, John Paisley
We propose a simple yet effective deep tree-structured fusion model based on feature aggregation for the deraining problem.
no code implementations • 16 May 2018 • Xueyang Fu, Borong Liang, Yue Huang, Xinghao Ding, John Paisley
In this paper, we propose a lightweight pyramid of networks (LPNet) for single image deraining.
no code implementations • 20 Apr 2018 • Zhiwen Fan, Huafeng Wu, Xueyang Fu, Yue Hunag, Xinghao Ding
Single image rain streaks removal is extremely important since rainy images adversely affect many computer vision systems.
no code implementations • ICCV 2017 • Junfeng Yang, Xueyang Fu, Yuwen Hu, Yue Huang, Xinghao Ding, John Paisley
We incorporate domain-specific knowledge to design our PanNet architecture by focusing on the two aims of the pan-sharpening problem: spectral and spatial preservation.
no code implementations • CVPR 2017 • Xueyang Fu, Jia-Bin Huang, Delu Zeng, Yue Huang, Xinghao Ding, John Paisley
We propose a new deep network architecture for removing rain streaks from individual images based on the deep convolutional neural network (CNN).
2 code implementations • 7 Sep 2016 • Xueyang Fu, Jia-Bin Huang, Xinghao Ding, Yinghao Liao, John Paisley
We introduce a deep network architecture called DerainNet for removing rain streaks from an image.
Ranked #11 on Single Image Deraining on Test100 (SSIM metric)
no code implementations • CVPR 2016 • Xueyang Fu, Delu Zeng, Yue Huang, Xiao-Ping Zhang, Xinghao Ding
We propose a weighted variational model to estimate both the reflectance and the illumination from an observed image.
no code implementations • 12 Feb 2013 • Yue Huang, John Paisley, Qin Lin, Xinghao Ding, Xueyang Fu, Xiao-Ping Zhang
The size of the dictionary and the patch-specific sparsity pattern are inferred from the data, in addition to other dictionary learning variables.