no code implementations • 19 Feb 2024 • Yan Hong, Jianfu Zhang
2) Hierarchical structure: WildFake contains fake images synthesized by different types of generators from GANs, diffusion models, to other generative models.
no code implementations • 19 Feb 2024 • Yan Hong, Jianfu Zhang
Recent advancements in personalizing text-to-image (T2I) diffusion models have shown the capability to generate images based on personalized visual concepts using a limited number of user-provided examples.
no code implementations • 27 Nov 2023 • Yuxuan Duan, Jianfu Zhang, Liqing Zhang
Dataset distillation (DD) is a newly emerging research area aiming at alleviating the heavy computational load in training models on large datasets.
no code implementations • 26 Oct 2023 • Junhong Gou, Bo Zhang, Li Niu, Jianfu Zhang, Jianlou Si, Chen Qian, Liqing Zhang
Specifically, our approach learns the human body priors and hallucinates the target locations of specified foreground keypoints in the background.
1 code implementation • 11 Aug 2023 • Junhong Gou, Siyu Sun, Jianfu Zhang, Jianlou Si, Chen Qian, Liqing Zhang
Our approach, namely Diffusion-based Conditional Inpainting for Virtual Try-ON (DCI-VTON), effectively utilizes the power of the diffusion model, and the incorporation of the warping module helps to produce high-quality and realistic virtual try-on results.
no code implementations • ECCV 2022. Lecture Notes in Computer Science, vol 13684 2022 • Yan Hong, Jianfu Zhang, Zhongyi Sun. Ke Yan
Contrastive loss ensures the transferable semantic directions are class-irrelevant and mode seeking loss is adopted to produce diverse tail-class features and enlarge the feature space of tail classes.
Ranked #29 on Long-tail Learning on CIFAR-10-LT (ρ=10)
no code implementations • 22 Jul 2022 • Yan Hong, Li Niu, Jianfu Zhang, Liqing Zhang
Few-shot image translation disentangles an image into style vector and content map.
1 code implementation • 21 Jul 2022 • Yan Hong, Li Niu, Jianfu Zhang, Liqing Zhang
In this work, we propose a novel Delta Generative Adversarial Network (DeltaGAN), which consists of a reconstruction subnetwork and a generation subnetwork.
no code implementations • CVPR 2022 • Wentao Wang, Li Niu, Jianfu Zhang, Xue Yang, Liqing Zhang
Different from feed-forward methods, they seek for a closest latent code to the corrupted image and feed it to a pretrained generator.
no code implementations • 29 Sep 2021 • Jianfu Zhang, Yan Hong, Dawei Cheng, Liqing Zhang, Qibin Zhao
In this paper, we propose a tensor-based framework for GNNs to learn robust graphs from adversarial graphs by aggregating predefined robust graphs to enhance the robustness of GNNs via tensor approximation.
no code implementations • 29 Sep 2021 • Jianfu Zhang, Yan Hong, Liqing Zhang, Qibin Zhao
Graph Neural Networks (GNNs) are fragile to adversarial attacks.
1 code implementation • 21 Apr 2021 • Yan Hong, Li Niu, Jianfu Zhang, Liqing Zhang
In this work, we focus on generating plausible shadow for the foreground object in the composite image.
1 code implementation • 31 Mar 2021 • Junyan Cao, Wenyan Cong, Li Niu, Jianfu Zhang, Liqing Zhang
Image harmonization has been significantly advanced with large-scale harmonization dataset.
no code implementations • ICCV 2021 • Wentao Wang, Jianfu Zhang, Li Niu, Haoyu Ling, Xue Yang, Liqing Zhang
Conventional deep image inpainting methods are based on auto-encoder architecture, in which the spatial details of images will be lost in the down-sampling process, leading to the degradation of generated results.
1 code implementation • 14 Dec 2020 • Ziqi Pan, Li Niu, Jianfu Zhang, Liqing Zhang
The information bottleneck (IB) method is a technique for extracting information that is relevant for predicting the target random variable from the source random variable, which is typically implemented by optimizing the IB Lagrangian that balances the compression and prediction terms.
1 code implementation • 19 Sep 2020 • Wenyan Cong, Li Niu, Jianfu Zhang, Jing Liang, Liqing Zhang
Therefore, we propose an image harmonization network with a novel domain code extractor and well-tailored triplet losses, which could capture the background domain information to guide the foreground harmonization.
Ranked #13 on Image Harmonization on iHarmony4
1 code implementation • 18 Sep 2020 • Yan Hong, Li Niu, Jianfu Zhang, Jing Liang, Liqing Zhang
In this work, we propose a novel Delta Generative Adversarial Network (DeltaGAN), which consists of a reconstruction subnetwork and a generation subnetwork.
1 code implementation • 5 Aug 2020 • Yan Hong, Li Niu, Jianfu Zhang, Weijie Zhao, Chen Fu, Liqing Zhang
In this paper, we propose a Fusing-and-Filling Generative Adversarial Network (F2GAN) to generate realistic and diverse images for a new category with only a few images.
no code implementations • 15 Mar 2020 • Yan Hong, Li Niu, Jianfu Zhang, Liqing Zhang
To address these issues, we propose our MTL with Selective Augmentation (MTL-SA) method to select the training samples in unlabeled datasets with confident pseudo labels and close data distribution to the labeled dataset.
1 code implementation • 7 Mar 2020 • Yan Hong, Li Niu, Jianfu Zhang, Liqing Zhang
Matching generator can match random vectors with a few conditional images from the same category and generate new images for this category based on the fused features.
no code implementations • 1 Dec 2019 • Yiyi Zhang, Li Niu, Ziqi Pan, Meichao Luo, Jianfu Zhang, Dawei Cheng, Liqing Zhang
Specifically, the VRE module includes a proxy task which imposes pseudo motion label constraint and temporal coherence constraint on unlabeled videos, while the MRA module could predict the motion information of a static action image by exploiting unlabeled videos.
1 code implementation • CVPR 2020 • Wenyan Cong, Jianfu Zhang, Li Niu, Liu Liu, Zhixin Ling, Weiyuan Li, Liqing Zhang
Image composition is an important operation in image processing, but the inconsistency between foreground and background significantly degrades the quality of composite image.
Ranked #6 on Image Harmonization on HAdobe5k(1024$\times$1024)
no code implementations • 24 Nov 2019 • Ruicong Xu, Li Niu, Jianfu Zhang, Liqing Zhang
Activity image-to-video retrieval task aims to retrieve videos containing the similar activity as the query image, which is a challenging task because videos generally have many background segments irrelevant to the activity.
1 code implementation • 28 Aug 2019 • Wenyan Cong, Jianfu Zhang, Li Niu, Liu Liu, Zhixin Ling, Weiyuan Li, Liqing Zhang
Image composition is an important operation in image processing, but the inconsistency between foreground and background significantly degrades the quality of composite image.
no code implementations • 16 May 2019 • Yaoyi Li, Jianfu Zhang, Weijie Zhao, Hongtao Lu
A high efficient image matting method based on a weakly annotated mask is in demand for mobile applications.
no code implementations • CVPR 2018 • Jianfu Zhang, Naiyan Wang, Liqing Zhang
In contrary to existing works that aggregate single frames features by time series model such as recurrent neural network, in this paper, we propose an interpretable reinforcement learning based approach to this problem.