Search Results for author: Jing Liao

Found 45 papers, 27 papers with code

Exploring Structure Consistency for Deep Model Watermarking

no code implementations5 Aug 2021 Jie Zhang, Dongdong Chen, Jing Liao, Han Fang, Zehua Ma, Weiming Zhang, Gang Hua, Nenghai Yu

However, little attention has been devoted to the protection of DNNs in image processing tasks.

Data Augmentation

Poison Ink: Robust and Invisible Backdoor Attack

no code implementations5 Aug 2021 Jie Zhang, Dongdong Chen, Jing Liao, Qidong Huang, Gang Hua, Weiming Zhang, Nenghai Yu

As the image structure can keep its semantic meaning during the data transformation, such trigger pattern is inherently robust to data transformations.

Adversarial Attack Data Poisoning

Deep Portrait Lighting Enhancement with 3D Guidance

no code implementations4 Aug 2021 Fangzhou Han, Can Wang, Hao Du, Jing Liao

To address this, we present a novel deep learning framework for portrait lighting enhancement based on 3D facial guidance.

Image-to-Image Translation Translation

PD-GAN: Probabilistic Diverse GAN for Image Inpainting

1 code implementation CVPR 2021 Hongyu Liu, Ziyu Wan, Wei Huang, Yibing Song, Xintong Han, Jing Liao

To this end, we propose spatially probabilistic diversity normalization (SPDNorm) inside the modulation to model the probability of generating a pixel conditioned on the context information.

Image Inpainting Image Restoration

Exemplar-Based 3D Portrait Stylization

no code implementations29 Apr 2021 Fangzhou Han, Shuquan Ye, Mingming He, Menglei Chai, Jing Liao

In the second texture style transfer stage, we focus on performing style transfer on the canonical texture by adopting a differentiable renderer to optimize the texture in a multi-view framework.

Style Transfer

Cross-Domain and Disentangled Face Manipulation with 3D Guidance

no code implementations22 Apr 2021 Can Wang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao

Face image manipulation via three-dimensional guidance has been widely applied in various interactive scenarios due to its semantically-meaningful understanding and user-friendly controllability.

Domain Adaptation Image Manipulation

Let's See Clearly: Contaminant Artifact Removal for Moving Cameras

no code implementations ICCV 2021 Xiaoyu Li, Bo Zhang, Jing Liao, Pedro V. Sander

This new dataset and our novel framework lead to our method that is able to address different contaminants and outperforms competitive restoration approaches both qualitatively and quantitatively.

Video Restoration

A Simple Baseline for StyleGAN Inversion

1 code implementation15 Apr 2021 Tianyi Wei, Dongdong Chen, Wenbo Zhou, Jing Liao, Weiming Zhang, Lu Yuan, Gang Hua, Nenghai Yu

This paper studies the problem of StyleGAN inversion, which plays an essential role in enabling the pretrained StyleGAN to be used for real facial image editing tasks.

Face Parsing

High-Fidelity Pluralistic Image Completion with Transformers

3 code implementations ICCV 2021 Ziyu Wan, Jingbo Zhang, Dongdong Chen, Jing Liao

Image completion has made tremendous progress with convolutional neural networks (CNNs), because of their powerful texture modeling capacity.

DeFLOCNet: Deep Image Editing via Flexible Low-level Controls

1 code implementation CVPR 2021 Hongyu Liu, Ziyu Wan, Wei Huang, Yibing Song, Xintong Han, Jing Liao, Bing Jiang, Wei Liu

While existing methods combine an input image and these low-level controls for CNN inputs, the corresponding feature representations are not sufficient to convey user intentions, leading to unfaithfully generated content.

Texture Synthesis

Diverse Semantic Image Synthesis via Probability Distribution Modeling

1 code implementation CVPR 2021 Zhentao Tan, Menglei Chai, Dongdong Chen, Jing Liao, Qi Chu, Bin Liu, Gang Hua, Nenghai Yu

In this paper, we propose a novel diverse semantic image synthesis framework from the perspective of semantic class distributions, which naturally supports diverse generation at semantic or even instance level.

Image Generation

Deep Model Intellectual Property Protection via Deep Watermarking

1 code implementation8 Mar 2021 Jie Zhang, Dongdong Chen, Jing Liao, Weiming Zhang, Huamin Feng, Gang Hua, Nenghai Yu

By jointly training the target model and watermark embedding, the extra barrier can even be absorbed into the target model.

Fine-tuning

Meta-PU: An Arbitrary-Scale Upsampling Network for Point Cloud

1 code implementation8 Feb 2021 Shuquan Ye, Dongdong Chen, Songfang Han, Ziyu Wan, Jing Liao

Thus, Meta-PU even outperforms the existing methods trained for a specific scale factor only.

Graphics

Efficient Semantic Image Synthesis via Class-Adaptive Normalization

1 code implementation8 Dec 2020 Zhentao Tan, Dongdong Chen, Qi Chu, Menglei Chai, Jing Liao, Mingming He, Lu Yuan, Gang Hua, Nenghai Yu

Spatially-adaptive normalization (SPADE) is remarkably successful recently in conditional semantic image synthesis \cite{park2019semantic}, which modulates the normalized activation with spatially-varying transformations learned from semantic layouts, to prevent the semantic information from being washed away.

Image Generation

LG-GAN: Label Guided Adversarial Network for Flexible Targeted Attack of Point Cloud-based Deep Networks

no code implementations1 Nov 2020 Hang Zhou, Dongdong Chen, Jing Liao, Weiming Zhang, Kejiang Chen, Xiaoyi Dong, Kunlin Liu, Gang Hua, Nenghai Yu

To overcome these shortcomings, this paper proposes a novel label guided adversarial network (LG-GAN) for real-time flexible targeted point cloud attack.

MichiGAN: Multi-Input-Conditioned Hair Image Generation for Portrait Editing

1 code implementation30 Oct 2020 Zhentao Tan, Menglei Chai, Dongdong Chen, Jing Liao, Qi Chu, Lu Yuan, Sergey Tulyakov, Nenghai Yu

In this paper, we present MichiGAN (Multi-Input-Conditioned Hair Image GAN), a novel conditional image generation method for interactive portrait hair manipulation.

Conditional Image Generation

Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search

1 code implementation NeurIPS 2020 Houwen Peng, Hao Du, Hongyuan Yu, Qi Li, Jing Liao, Jianlong Fu

The experiments on ImageNet verify such path distillation method can improve the convergence ratio and performance of the hypernetwork, as well as boosting the training of subnetworks.

Neural Architecture Search Object Detection

Passport-aware Normalization for Deep Model Protection

1 code implementation NeurIPS 2020 Jie Zhang, Dongdong Chen, Jing Liao, Weiming Zhang, Gang Hua, Nenghai Yu

Only when the model IP is suspected to be stolen by someone, the private passport-aware branch is added back for ownership verification.

Fine-tuning Model Compression

Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Network

1 code implementation12 Oct 2020 Jialu Huang, Jing Liao, Sam Kwong

We proposed a new I2I translation method that generates a new model in the target domain via a series of model transformations on a pre-trained StyleGAN2 model in the source domain.

Colorization Semantic Similarity +4

Old Photo Restoration via Deep Latent Space Translation

5 code implementations14 Sep 2020 Zi-Yu Wan, Bo Zhang, Dong-Dong Chen, Pan Zhang, Dong Chen, Jing Liao, Fang Wen

Unlike conventional restoration tasks that can be solved through supervised learning, the degradation in real photos is complex and the domain gap between synthetic images and real old photos makes the network fail to generalize.

Image Restoration Translation

Deep Sketch-guided Cartoon Video Inbetweening

1 code implementation10 Aug 2020 Xiaoyu Li, Bo Zhang, Jing Liao, Pedro V. Sander

The key idea of the proposed approach is to estimate the dense cross-domain correspondence between the sketch and cartoon video frames, and employ a blending module with occlusion estimation to synthesize the middle frame guided by the sketch.

Image Generation Occlusion Estimation

Multi-Density Sketch-to-Image Translation Network

no code implementations18 Jun 2020 Jialu Huang, Jing Liao, Zhifeng Tan, Sam Kwong

Sketch-to-image (S2I) translation plays an important role in image synthesis and manipulation tasks, such as photo editing and colorization.

Colorization Image Generation +2

Bringing Old Photos Back to Life

5 code implementations CVPR 2020 Zi-Yu Wan, Bo Zhang, Dong-Dong Chen, Pan Zhang, Dong Chen, Jing Liao, Fang Wen

Unlike conventional restoration tasks that can be solved through supervised learning, the degradation in real photos is complex and the domain gap between synthetic images and real old photos makes the network fail to generalize.

Image Restoration Translation

Rethinking Spatially-Adaptive Normalization

no code implementations6 Apr 2020 Zhentao Tan, Dongdong Chen, Qi Chu, Menglei Chai, Jing Liao, Mingming He, Lu Yuan, Nenghai Yu

Despite its impressive performance, a more thorough understanding of the true advantages inside the box is still highly demanded, to help reduce the significant computation and parameter overheads introduced by these new structures.

Image Generation

Application of Structural Similarity Analysis of Visually Salient Areas and Hierarchical Clustering in the Screening of Similar Wireless Capsule Endoscopic Images

no code implementations1 Apr 2020 Rui Nie, Huan Yang, Hejuan Peng, Wenbin Luo, Weiya Fan, Jie Zhang, Jing Liao, Fang Huang, Yufeng Xiao

Small intestinal capsule endoscopy is the mainstream method for inspecting small intestinal lesions, but a single small intestinal capsule endoscopy will produce 60, 000 - 120, 000 images, the majority of which are similar and have no diagnostic value.

Model Watermarking for Image Processing Networks

1 code implementation25 Feb 2020 Jie Zhang, Dong-Dong Chen, Jing Liao, Han Fang, Weiming Zhang, Wenbo Zhou, HAO CUI, Nenghai Yu

In this way, when the attacker trains one surrogate model by using the input-output pairs of the target model, the hidden watermark will be learned and extracted afterward.

Style Mixer: Semantic-aware Multi-Style Transfer Network

1 code implementation29 Oct 2019 Zixuan Huang, Jinghuai Zhang, Jing Liao

Recent neural style transfer frameworks have obtained astonishing visual quality and flexibility in Single-style Transfer (SST), but little attention has been paid to Multi-style Transfer (MST) which refers to simultaneously transferring multiple styles to the same image.

Style Transfer

Semantic Example Guided Image-to-Image Translation

no code implementations28 Sep 2019 Jialu Huang, Jing Liao, Tak Wu Sam Kwong

Given a reference image and an input in another domain, a semantic matching is first performed between the two visual contents and generates the auxiliary image, which is explicitly encouraged to preserve semantic characteristics of the reference.

Image-to-Image Translation Translation

Document Rectification and Illumination Correction using a Patch-based CNN

1 code implementation20 Sep 2019 Xiaoyu Li, Bo Zhang, Jing Liao, Pedro V. Sander

We propose a novel learning method to rectify document images with various distortion types from a single input image.

Optical Character Recognition Rectification

Blind Geometric Distortion Correction on Images Through Deep Learning

no code implementations CVPR 2019 Xiaoyu Li, Bo Zhang, Pedro V. Sander, Jing Liao

We propose the first general framework to automatically correct different types of geometric distortion in a single input image.

Transductive Zero-Shot Learning with Visual Structure Constraint

1 code implementation NeurIPS 2019 Zi-Yu Wan, Dong-Dong Chen, Yan Li, Xingguang Yan, Junge Zhang, Yizhou Yu, Jing Liao

Based on the observation that visual features of test instances can be separated into different clusters, we propose a new visual structure constraint on class centers for transductive ZSL, to improve the generality of the projection function (i. e. alleviate the above domain shift problem).

Zero-Shot Learning

CariGANs: Unpaired Photo-to-Caricature Translation

no code implementations1 Nov 2018 Kaidi Cao, Jing Liao, Lu Yuan

Facial caricature is an art form of drawing faces in an exaggerated way to convey humor or sarcasm.

Caricature Photo-To-Caricature Translation +1

Deep Video-Based Performance Cloning

no code implementations21 Aug 2018 Kfir Aberman, Mingyi Shi, Jing Liao, Dani Lischinski, Baoquan Chen, Daniel Cohen-Or

After training a deep generative network using a reference video capturing the appearance and dynamics of a target actor, we are able to generate videos where this actor reenacts other performances.

Motion Capture

Deep Exemplar-based Colorization

1 code implementation17 Jul 2018 Mingming He, Dong-Dong Chen, Jing Liao, Pedro V. Sander, Lu Yuan

More importantly, as opposed to other learning-based colorization methods, our network allows the user to achieve customizable results by simply feeding different references.

Colorization Image Retrieval

Neural Best-Buddies: Sparse Cross-Domain Correspondence

2 code implementations10 May 2018 Kfir Aberman, Jing Liao, Mingyi Shi, Dani Lischinski, Baoquan Chen, Daniel Cohen-Or

Correspondence between images is a fundamental problem in computer vision, with a variety of graphics applications.

Image Morphing

Arbitrary Style Transfer with Deep Feature Reshuffle

1 code implementation CVPR 2018 Shuyang Gu, Congliang Chen, Jing Liao, Lu Yuan

We theoretically prove that our new style loss based on reshuffle connects both global and local style losses respectively used by most parametric and non-parametric neural style transfer methods.

Style Transfer

Stereoscopic Neural Style Transfer

no code implementations CVPR 2018 Dongdong Chen, Lu Yuan, Jing Liao, Nenghai Yu, Gang Hua

This paper presents the first attempt at stereoscopic neural style transfer, which responds to the emerging demand for 3D movies or AR/VR.

Style Transfer

Progressive Color Transfer with Dense Semantic Correspondences

2 code implementations2 Oct 2017 Mingming He, Jing Liao, Dong-Dong Chen, Lu Yuan, Pedro V. Sander

The proposed method can be successfully extended from one-to-one to one-to-many color transfer.

Visual Attribute Transfer through Deep Image Analogy

5 code implementations2 May 2017 Jing Liao, Yuan YAO, Lu Yuan, Gang Hua, Sing Bing Kang

We propose a new technique for visual attribute transfer across images that may have very different appearance but have perceptually similar semantic structure.

StyleBank: An Explicit Representation for Neural Image Style Transfer

no code implementations CVPR 2017 Dongdong Chen, Lu Yuan, Jing Liao, Nenghai Yu, Gang Hua

It also enables us to conduct incremental learning to add a new image style by learning a new filter bank while holding the auto-encoder fixed.

Incremental Learning Style Transfer

Coherent Online Video Style Transfer

no code implementations ICCV 2017 Dongdong Chen, Jing Liao, Lu Yuan, Nenghai Yu, Gang Hua

Training a feed-forward network for fast neural style transfer of images is proven to be successful.

Image Stylization Video Style Transfer

Cannot find the paper you are looking for? You can Submit a new open access paper.