Search Results for author: Jinjin Gu

Found 31 papers, 14 papers with code

Mitigating Artifacts in Real-World Video Super-Resolution Models

1 code implementation14 Dec 2022 Liangbin Xie, Xintao Wang, Shuwei Shi, Jinjin Gu, Chao Dong, Ying Shan

To aggregate a new hidden state that contains fewer artifacts from the hidden state pool, we devise a Selective Cross Attention (SCA) module, in which the attention between input features and each hidden state is calculated.

Video Super-Resolution

Cross Aggregation Transformer for Image Restoration

1 code implementation24 Nov 2022 Chen Zheng, Yulun Zhang, Jinjin Gu, Yongbing Zhang, Linghe Kong, Xin Yuan

The core of our CAT is the Rectangle-Window Self-Attention (Rwin-SA), which utilizes horizontal and vertical rectangle window attention in different heads parallelly to expand the attention area and aggregate the features cross different windows.

Image Restoration Inductive Bias

Self-Supervised Intensity-Event Stereo Matching

no code implementations1 Nov 2022 Jinjin Gu, Jinan Zhou, Ringo Sai Wo Chu, Yan Chen, Jiawei Zhang, Xuanye Cheng, Song Zhang, Jimmy S. Ren

Event cameras are novel bio-inspired vision sensors that output pixel-level intensity changes in microsecond accuracy with a high dynamic range and low power consumption.

Self-Supervised Learning Stereo Matching

Near Real-time CO$_2$ Emissions Based on Carbon Satellite and Artificial Intelligence

no code implementations11 Oct 2022 Zhengwen Zhang, Jinjin Gu, Junhua Zhao, Jianwei Huang, Haifeng Wu

Here we provide the first method that combines the advanced artificial intelligence (AI) techniques and the carbon satellite monitor to quantify anthropogenic CO$_2$ emissions.

Retrieval

Super-Resolution by Predicting Offsets: An Ultra-Efficient Super-Resolution Network for Rasterized Images

no code implementations9 Oct 2022 Jinjin Gu, Haoming Cai, Chenyu Dong, Ruofan Zhang, Yulun Zhang, Wenming Yang, Chun Yuan

We finally use a guided fusion operation to integrate the sharp edges generated by the network and flat areas by the interpolation method to get the final SR image.

Quantization Super-Resolution

Accurate Image Restoration with Attention Retractable Transformer

1 code implementation4 Oct 2022 Jiale Zhang, Yulun Zhang, Jinjin Gu, Yongbing Zhang, Linghe Kong, Xin Yuan

This is considered as a dense attention strategy since the interactions of tokens are restrained in dense regions.

Denoising Image Restoration +2

NTIRE 2022 Challenge on Perceptual Image Quality Assessment

no code implementations23 Jun 2022 Jinjin Gu, Haoming Cai, Chao Dong, Jimmy S. Ren, Radu Timofte

This challenge is divided into two tracks, a full-reference IQA track similar to the previous NTIRE IQA challenge and a new track that focuses on the no-reference IQA methods.

Image Quality Assessment Image Restoration

Evaluating the Generalization Ability of Super-Resolution Networks

no code implementations14 May 2022 Yihao Liu, Hengyuan Zhao, Jinjin Gu, Yu Qiao, Chao Dong

However, research on the generalization ability of Super-Resolution (SR) networks is currently absent.

Super-Resolution

Blueprint Separable Residual Network for Efficient Image Super-Resolution

1 code implementation12 May 2022 Zheyuan Li, Yingqi Liu, Xiangyu Chen, Haoming Cai, Jinjin Gu, Yu Qiao, Chao Dong

One is the usage of blueprint separable convolution (BSConv), which takes place of the redundant convolution operation.

Image Super-Resolution Single Image Super Resolution

Texture-Based Error Analysis for Image Super-Resolution

no code implementations CVPR 2022 Salma Abdel Magid, Zudi Lin, Donglai Wei, Yulun Zhang, Jinjin Gu, Hanspeter Pfister

Our key contribution is to leverage a texture classifier, which enables us to assign patches with semantic labels, to identify the source of SR errors both globally and locally.

Image Super-Resolution SSIM

Reflash Dropout in Image Super-Resolution

no code implementations CVPR 2022 Xiangtao Kong, Xina Liu, Jinjin Gu, Yu Qiao, Chao Dong

Dropout is designed to relieve the overfitting problem in high-level vision tasks but is rarely applied in low-level vision tasks, like image super-resolution (SR).

Common Sense Reasoning Image Super-Resolution +1

Blind Image Super-Resolution: A Survey and Beyond

no code implementations7 Jul 2021 Anran Liu, Yihao Liu, Jinjin Gu, Yu Qiao, Chao Dong

This paper serves as a systematic review on recent progress in blind image SR, and proposes a taxonomy to categorize existing methods into three different classes according to their ways of degradation modelling and the data used for solving the SR model.

Image Super-Resolution

Attention in Attention Network for Image Super-Resolution

2 code implementations19 Apr 2021 Haoyu Chen, Jinjin Gu, Zhi Zhang

In this work, we attempt to quantify and visualize attention mechanisms in SISR and show that not all attention modules are equally beneficial.

Image Super-Resolution Single Image Super Resolution

Image Quality Assessment for Perceptual Image Restoration: A New Dataset, Benchmark and Metric

no code implementations30 Nov 2020 Jinjin Gu, Haoming Cai, Haoyu Chen, Xiaoxing Ye, Jimmy Ren, Chao Dong

To answer the questions and promote the development of IQA methods, we contribute a large-scale IQA dataset, called Perceptual Image Processing ALgorithms (PIPAL) dataset.

Image Quality Assessment Image Restoration

Interpreting Super-Resolution Networks with Local Attribution Maps

no code implementations CVPR 2021 Jinjin Gu, Chao Dong

Based on LAM, we show that: (1) SR networks with a wider range of involved input pixels could achieve better performance.

Image Super-Resolution

PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restoration

no code implementations ECCV 2020 Jinjin Gu, Haoming Cai, Haoyu Chen, Xiaoxing Ye, Jimmy Ren, Chao Dong

To answer these questions and promote the development of IQA methods, we contribute a large-scale IQA dataset, called Perceptual Image Processing Algorithms (PIPAL) dataset.

Image Quality Assessment Image Restoration +1

Image Processing Using Multi-Code GAN Prior

1 code implementation CVPR 2020 Jinjin Gu, Yujun Shen, Bolei Zhou

Such an over-parameterization of the latent space significantly improves the image reconstruction quality, outperforming existing competitors.

Blind Face Restoration Colorization +6

Interpreting the Latent Space of GANs for Semantic Face Editing

4 code implementations CVPR 2020 Yujun Shen, Jinjin Gu, Xiaoou Tang, Bolei Zhou

In this work, we propose a novel framework, called InterFaceGAN, for semantic face editing by interpreting the latent semantics learned by GANs.

Disentanglement Face Generation +1

Suppressing Model Overfitting for Image Super-Resolution Networks

no code implementations11 Jun 2019 Ruicheng Feng, Jinjin Gu, Yu Qiao, Chao Dong

Large deep networks have demonstrated competitive performance in single image super-resolution (SISR), with a huge volume of data involved.

Image Super-Resolution Memorization +1

Rethinking the Pipeline of Demosaicing, Denoising and Super-Resolution

1 code implementation7 May 2019 Guocheng Qian, Yuanhao Wang, Chao Dong, Jimmy S. Ren, Wolfgang Heidrich, Bernard Ghanem, Jinjin Gu

Such a mixture problem is usually solved by a sequential solution (applying each method independently in a fixed order: DM $\to$ DN $\to$ SR), or is simply tackled by an end-to-end network without enough analysis into interactions among tasks, resulting in an undesired performance drop in the final image quality.

Demosaicking Denoising +1

Blind Super-Resolution With Iterative Kernel Correction

3 code implementations CVPR 2019 Jinjin Gu, Hannan Lu, WangMeng Zuo, Chao Dong

In this paper, we propose an Iterative Kernel Correction (IKC) method for blur kernel estimation in blind SR problem, where the blur kernels are unknown.

Blind Super-Resolution Image Super-Resolution

Two-phase Hair Image Synthesis by Self-Enhancing Generative Model

no code implementations28 Feb 2019 Haonan Qiu, Chuan Wang, Hang Zhu, Xiangyu Zhu, Jinjin Gu, Xiaoguang Han

Generating plausible hair image given limited guidance, such as sparse sketches or low-resolution image, has been made possible with the rise of Generative Adversarial Networks (GANs).

Image-to-Image Translation Super-Resolution +1

Super-Resolution Perception for Industrial Sensor Data

no code implementations6 Sep 2018 Jinjin Gu, Haoyu Chen, Guolong Liu, Gaoqi Liang, Xinlei Wang, Junhua Zhao

In this paper, we present the problem formulation and methodology framework of Super-Resolution Perception (SRP) on industrial sensor data.

Fault Detection Super-Resolution

ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks

39 code implementations1 Sep 2018 Xintao Wang, Ke Yu, Shixiang Wu, Jinjin Gu, Yihao Liu, Chao Dong, Chen Change Loy, Yu Qiao, Xiaoou Tang

To further enhance the visual quality, we thoroughly study three key components of SRGAN - network architecture, adversarial loss and perceptual loss, and improve each of them to derive an Enhanced SRGAN (ESRGAN).

Face Hallucination Image Super-Resolution +2

Single Image Reflection Removal Using Deep Encoder-Decoder Network

3 code implementations31 Jan 2018 Zhixiang Chi, Xiaolin Wu, Xiao Shu, Jinjin Gu

Image of a scene captured through a piece of transparent and reflective material, such as glass, is often spoiled by a superimposed layer of reflection image.

Reflection Removal

Cannot find the paper you are looking for? You can Submit a new open access paper.