Search Results for author: Zhilu Zhang

Found 30 papers, 25 papers with code

DreamPhysics: Learning Physical Properties of Dynamic 3D Gaussians with Video Diffusion Priors

1 code implementation3 Jun 2024 Tianyu Huang, Haoze Zhang, Yihan Zeng, Zhilu Zhang, Hui Li, WangMeng Zuo, Rynson W. H. Lau

In this work, combining the strengths and complementing shortcomings of the above two solutions, we propose to learn the physical properties of a material field with video diffusion priors, and then utilize a physics-based Material-Point-Method (MPM) simulator to generate 4D content with realistic motions.

Self-Supervised Learning for Real-World Super-Resolution from Dual and Multiple Zoomed Observations

2 code implementations3 May 2024 Zhilu Zhang, Ruohao Wang, Hongzhi Zhang, WangMeng Zuo

In addition, we further take multiple zoomed observations to explore self-supervised RefSR, and present a progressive fusion scheme for the effective utilization of reference images.

Optical Flow Estimation Reference-based Super-Resolution +1

NIR-Assisted Image Denoising: A Selective Fusion Approach and A Real-World Benchmark Dataset

1 code implementation12 Apr 2024 Rongjian Xu, Zhilu Zhang, Renlong Wu, WangMeng Zuo

Despite the significant progress in image denoising, it is still challenging to restore fine-scale details while removing noise, especially in extremely low-light environments.

Image Denoising

TBSN: Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising

1 code implementation11 Apr 2024 Junyi Li, Zhilu Zhang, WangMeng Zuo

For channel self-attention, we observe that it may leak the blind-spot information when the channel number is greater than spatial size in the deep layers of multi-scale architectures.

Computational Efficiency Image Denoising +2

Dual-Camera Smooth Zoom on Mobile Phones

1 code implementation7 Apr 2024 Renlong Wu, Zhilu Zhang, Yu Yang, WangMeng Zuo

In this work, we introduce a new task, ie, dual-camera smooth zoom (DCSZ) to achieve a smooth zoom preview.

Self-Supervised Video Desmoking for Laparoscopic Surgery

1 code implementation17 Mar 2024 Renlong Wu, Zhilu Zhang, Shuohao Zhang, Longfei Gou, Haobin Chen, Lei Zhang, Hao Chen, WangMeng Zuo

On the other hand, in order to enhance the desmoking performance, we further feed the valuable information from PS frame into models, where a masking strategy and a regularization term are presented to avoid trivial solutions.

Exposure Bracketing is All You Need for Unifying Image Restoration and Enhancement Tasks

2 code implementations1 Jan 2024 Zhilu Zhang, Shuohao Zhang, Renlong Wu, Zifei Yan, WangMeng Zuo

It is highly desired but challenging to acquire high-quality photos with clear content in low-light environments.

Deblurring Denoising +2

Improving Image Restoration through Removing Degradations in Textual Representations

1 code implementation CVPR 2024 Jingbo Lin, Zhilu Zhang, Yuxiang Wei, Dongwei Ren, Dongsheng Jiang, WangMeng Zuo

To address the cross-modal assistance, we propose to map the degraded images into textual representations for removing the degradations, and then convert the restored textual representations into a guidance image for assisting image restoration.

Deblurring Denoising +3

DreamControl: Control-Based Text-to-3D Generation with 3D Self-Prior

1 code implementation CVPR 2024 Tianyu Huang, Yihan Zeng, Zhilu Zhang, Wan Xu, Hang Xu, Songcen Xu, Rynson W. H. Lau, WangMeng Zuo

The priors are then regarded as input conditions to maintain reasonable geometries, in which conditional LoRA and weighted score are further proposed to optimize detailed textures.

3D Generation Text to 3D

Learning Real-World Image De-Weathering with Imperfect Supervision

1 code implementation23 Oct 2023 Xiaohui Liu, Zhilu Zhang, Xiaohe Wu, Chaoyu Feng, Xiaotao Wang, Lei Lei, WangMeng Zuo

Real-world image de-weathering aims at removing various undesirable weather-related artifacts.

Pseudo Label

Self-Supervised High Dynamic Range Imaging with Multi-Exposure Images in Dynamic Scenes

1 code implementation3 Oct 2023 Zhilu Zhang, Haoyu Wang, Shuai Liu, Xiaotao Wang, Lei Lei, WangMeng Zuo

The color component is estimated from aligned multi-exposure images, while the structure one is generated through a structure-focused network that is supervised by the color component and an input reference (\eg, medium-exposure) image.

HDR Reconstruction

RBSR: Efficient and Flexible Recurrent Network for Burst Super-Resolution

1 code implementation30 Jun 2023 Renlong Wu, Zhilu Zhang, Shuohao Zhang, Hongzhi Zhang, WangMeng Zuo

The main challenge of BurstSR is to effectively combine the complementary information from input frames, while existing methods still struggle with it.

Super-Resolution

Benchmark Dataset and Effective Inter-Frame Alignment for Real-World Video Super-Resolution

1 code implementation10 Dec 2022 Ruohao Wang, Xiaohui Liu, Zhilu Zhang, Xiaohe Wu, Chun-Mei Feng, Lei Zhang, WangMeng Zuo

On the other hand, alignment algorithms in existing VSR methods perform poorly for real-world videos, leading to unsatisfactory results.

Optical Flow Estimation Video Super-Resolution

Self-Supervised Image Restoration with Blurry and Noisy Pairs

1 code implementation14 Nov 2022 Zhilu Zhang, Rongjian Xu, Ming Liu, Zifei Yan, WangMeng Zuo

By learning in a collaborative manner, the deblurring and denoising tasks in our method can benefit each other.

Deblurring Denoising +1

Self-Supervised Learning for Real-World Super-Resolution from Dual Zoomed Observations

2 code implementations2 Mar 2022 Zhilu Zhang, Ruohao Wang, Hongzhi Zhang, Yunjin Chen, WangMeng Zuo

For this purpose, we take the telephoto image instead of an additional high-resolution image as the supervision information and select a center patch from it as the reference to super-resolve the corresponding short-focus image patch.

Reference-based Super-Resolution Self-Supervised Learning

Learning RAW-to-sRGB Mappings with Inaccurately Aligned Supervision

1 code implementation ICCV 2021 Zhilu Zhang, Haolin Wang, Ming Liu, Ruohao Wang, Jiawei Zhang, WangMeng Zuo

To diminish the effect of color inconsistency in image alignment, we introduce to use a global color mapping (GCM) module to generate an initial sRGB image given the input raw image, which can keep the spatial location of the pixels unchanged, and the target sRGB image is utilized to guide GCM for converting the color towards it.

Optical Flow Estimation

Ex uno plures: Splitting One Model into an Ensemble of Subnetworks

no code implementations9 Jun 2021 Zhilu Zhang, Vianne R. Gao, Mert R. Sabuncu

We show that the proposed subnetwork ensembling method can perform as well as standard deep ensembles in both accuracy and uncertainty estimates, yet with a computational efficiency similar to MC dropout.

Computational Efficiency Diversity

Real-Time Uncertainty Estimation in Computer Vision via Uncertainty-Aware Distribution Distillation

no code implementations31 Jul 2020 Yichen Shen, Zhilu Zhang, Mert R. Sabuncu, Lin Sun

We propose a simple, easy-to-optimize distillation method for learning the conditional predictive distribution of a pre-trained dropout model for fast, sample-free uncertainty estimation in computer vision tasks.

Depth Estimation Semantic Segmentation +1

Self-Distillation as Instance-Specific Label Smoothing

1 code implementation NeurIPS 2020 Zhilu Zhang, Mert R. Sabuncu

It has been recently demonstrated that multi-generational self-distillation can improve generalization.

Diversity

Two-Dimensional Semi-Nonnegative Matrix Factorization for Clustering

no code implementations19 May 2020 Chong Peng, Zhilu Zhang, Zhao Kang, Chenglizhao Chen, Qiang Cheng

In particular, projection matrices are sought under the guidance of building new data representations, such that the spatial information is retained and projections are enhanced by the goal of clustering, which helps construct optimal projection directions.

Clustering Vocal Bursts Valence Prediction

Deep Adaptive Inference Networks for Single Image Super-Resolution

1 code implementation8 Apr 2020 Ming Liu, Zhilu Zhang, Liya Hou, WangMeng Zuo, Lei Zhang

Nonetheless, content and resource adaptive model is more preferred, and it is encouraging to apply simpler and efficient networks to the easier regions with less details and the scenarios with restricted efficiency constraints.

Image Super-Resolution

Omnibus Dropout for Improving The Probabilistic Classification Outputs of ConvNets

no code implementations25 Sep 2019 Zhilu Zhang, Adrian V. Dalca, Mert R. Sabuncu

Motivated by this, we explore the use of various structured dropout techniques to promote model diversity and improve the quality of probabilistic predictions.

Active Learning Classification +2

Confidence Calibration for Convolutional Neural Networks Using Structured Dropout

no code implementations23 Jun 2019 Zhilu Zhang, Adrian V. Dalca, Mert R. Sabuncu

Motivated by this, we explore the use of structured dropout to promote model diversity and improve confidence calibration.

Active Learning Bayesian Inference +2

Cannot find the paper you are looking for? You can Submit a new open access paper.