no code implementations • ECCV 2020 • Pei-Pei Li, Huaibo Huang, Yibo Hu, Xiang Wu, Ran He, Zhenan Sun
To explore the age effects on facial images, we propose a Disentangled Adversarial Autoencoder (DAAE) to disentangle the facial images into three independent factors: age, identity and extraneous information.
no code implementations • 12 Mar 2024 • Haokun Lin, Haoli Bai, Zhili Liu, Lu Hou, Muyi Sun, Linqi Song, Ying WEI, Zhenan Sun
We find that directly using smaller pre-trained models and applying magnitude-based pruning on CLIP models leads to inflexibility and inferior performance.
1 code implementation • journal 2023 • Bo Peng, Xianyun Sun, Caiyong Wang, Wei Wang1, Jing Dong, Zhenan Sun
This paper presents the summary report on the DeepFake Game Competition on Visual Realism Assessment (DFGCVRA).
1 code implementation • 27 Aug 2023 • Hongda Liu, Yunlong Wang, Min Ren, Junxing Hu, Zhengquan Luo, Guangqi Hou, Zhenan Sun
Secondly, we design a detached action-aware learning schedule to further mitigate the bias in the representation space.
1 code implementation • 27 Jul 2023 • Min Ren, Yunlong Wang, Yuhao Zhu, Kunbo Zhang, Zhenan Sun
Occlusion is a common problem with biometric recognition in the wild.
no code implementations • 31 May 2023 • Junxing Hu, Hongwen Zhang, Zerui Chen, Mengcheng Li, Yunlong Wang, Yebin Liu, Zhenan Sun
In the second part, we introduce a novel method to diffuse estimated contact states from the hand mesh surface to nearby 3D space and leverage diffused contact probabilities to construct the implicit neural representation for the manipulated object.
no code implementations • 25 Feb 2023 • Jawad Muhammad, Yunlong Wang, Junxing Hu, Kunbo Zhang, Zhenan Sun
The database contains 28, 717 images of 1023 African subjects (2046 iris classes) with age, gender, and ethnicity attributes that can be useful in demographically sensitive studies of Africans.
1 code implementation • 13 Jan 2023 • Jie Gui, Tuo Chen, Jing Zhang, Qiong Cao, Zhenan Sun, Hao Luo, DaCheng Tao
Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance.
1 code implementation • 5 Jan 2023 • Boqiang Xu, Lingxiao He, Jian Liang, Zhenan Sun
To reduce the interference of the noise during feature matching, we mainly focus on visible regions that appear in both images and develop a visibility graph to calculate the similarity.
no code implementations • 23 Nov 2022 • Yunfan Liu, Qi Li, Zhenan Sun, Tieniu Tan
One-shot face re-enactment is a challenging task due to the identity mismatch between source and driving faces.
no code implementations • 11 Nov 2022 • Kaiduo Zhang, Muyi Sun, Jianxin Sun, Binghao Zhao, Kunbo Zhang, Zhenan Sun, Tieniu Tan
In this paper, we propose HumanDiffusion, a coarse-to-fine alignment diffusion framework, for text-driven person image generation.
no code implementations • 23 Oct 2022 • Yunfan Liu, Qi Li, Qiyao Deng, Zhenan Sun, Ming-Hsuan Yang
Facial Attribute Manipulation (FAM) aims to aesthetically modify a given face image to render desired attributes, which has received significant attention due to its broad practical applications ranging from digital entertainment to biometric forensics.
1 code implementation • 26 Jul 2022 • Xingqun Qi, Zhuojie Wu, Min Ren, Muyi Sun, Caifeng Shan, Zhenan Sun
Considering the domain-invariant representative vectors in MSAN, we propose two generalizable knowledge distillation schemes for cross-domain distillation, Dual Contrastive Graph Distillation (DCGD) and Domain-Invariant Cross Distillation (DICD).
1 code implementation • 13 Jul 2022 • Min Ren, Yuhao Zhu, Yunlong Wang, Zhenan Sun
A straightforward approach is to inactivate the adversarial perturbations so that they can be easily handled as general perturbations.
1 code implementation • 13 Jul 2022 • Hongwen Zhang, Yating Tian, Yuxiang Zhang, Mengcheng Li, Liang An, Zhenan Sun, Yebin Liu
To address these issues, we propose a Pyramidal Mesh Alignment Feedback (PyMAF) loop in our regression network for well-aligned human mesh recovery and extend it as PyMAF-X for the recovery of expressive full-body models.
Ranked #6 on 3D Human Pose Estimation on AGORA (using extra training data)
1 code implementation • 30 Jun 2022 • Bo Peng, Wei Xiang, Yue Jiang, Wei Wang, Jing Dong, Zhenan Sun, Zhen Lei, Siwei Lyu
There is a two-party game between DeepFake creators and defenders.
no code implementations • 14 Jun 2022 • Zhengquan Luo, Yunlong Wang, Zilei Wang, Zhenan Sun, Tieniu Tan
Attributes skew hinders the current federated learning (FL) frameworks from consistent optimization directions among the clients, which inevitably leads to performance reduction and unstable convergence.
no code implementations • 6 Apr 2022 • Zhuojie Wu, Xingqun Qi, Zijian Wang, Wanting Zhou, Kun Yuan, Muyi Sun, Zhenan Sun
Furthermore, to better improve the inter-coordination between the corrupted and non-corrupted regions and enhance the intra-coordination in corrupted regions, we design InCo2 Loss, a pair of similarity based losses to constrain the feature consistency.
no code implementations • CVPR 2022 • Jianxin Sun, Qiyao Deng, Qi Li, Muyi Sun, Min Ren, Zhenan Sun
AnyFace can achieve high-quality, high-resolution, and high-diversity face synthesis and manipulation results without any constraints on the number and content of input captions.
1 code implementation • 24 Mar 2022 • Qi Li, Weining Wang, Chengzhong Xu, Zhenan Sun
In addition, semantic information is introduced into the semantic-guided fusion module to control the swapped area and model the pose and expression more accurately.
no code implementations • 8 Feb 2022 • Fan Ji, Muyi Sun, Xingqun Qi, Qi Li, Zhenan Sun
Furthermore, we design a novel Memory Refinement Loss (MR Loss) for feature alignment in the memory module, which enhances the accuracy of memory slots in an unsupervised manner.
1 code implementation • 16 Dec 2021 • Boqiang Xu, Jian Liang, Lingxiao He, Zhenan Sun
Meanwhile, META considers the relevance of an unseen target sample and source domains via normalization statistics and develops an aggregation module to adaptively integrate multiple experts for mimicking unseen target domain.
no code implementations • 20 Oct 2021 • Jianze Wei, Huaibo Huang, Muyi Sun, Yunlong Wang, Min Ren, Ran He, Zhenan Sun
To make further efforts on accurate and reliable iris segmentation, we propose a bilateral self-attention module and design Bilateral Transformer (BiTrans) with hierarchical architecture by exploring spatial and visual relationships.
no code implementations • 15 Sep 2021 • Muyi Sun, Jian Wang, Yunfan Liu, Qi Li, Zhenan Sun
Biphasic facial age translation aims at predicting the appearance of the input face at any age.
1 code implementation • 29 Jun 2021 • Leyuan Wang, Kunbo Zhang, Yunlong Wang, Zhenan Sun
To accommodate users at different distances, it is necessary to control focus quickly and accurately.
1 code implementation • 2 Jun 2021 • Bo Peng, Hongxing Fan, Wei Wang, Jing Dong, Yuezun Li, Siwei Lyu, Qi Li, Zhenan Sun, Han Chen, Baoying Chen, Yanjie Hu, Shenghai Luo, Junrui Huang, Yutong Yao, Boyuan Liu, Hefei Ling, Guosheng Zhang, Zhiliang Xu, Changtao Miao, Changlei Lu, Shan He, Xiaoyan Wu, Wanyi Zhuang
This competition provides a common platform for benchmarking the adversarial game between current state-of-the-art DeepFake creation and detection methods.
1 code implementation • CVPR 2021 • Yuhao Zhu, Qi Li, Jian Wang, Chengzhong Xu, Zhenan Sun
Extensive experiments demonstrate the superiority of MegaFS and the first megapixel level face swapping database is released for research on DeepFake detection and face image editing in the public domain.
Ranked #8 on Face Swapping on FaceForensics++
no code implementations • 8 May 2021 • Jawad Muhammad, Yunlong Wang, Caiyong Wang, Kunbo Zhang, Zhenan Sun
The proposed database along with its face landmark annotations, evaluation protocols and preliminary results form a good benchmark to study the essential aspects of face biometrics for African subjects, especially face image preprocessing, face feature analysis and matching, facial expression recognition, sex/age estimation, ethnic classification, face image generation, etc.
1 code implementation • CVPR 2021 • Jie Cao, Luanxuan Hou, Ming-Hsuan Yang, Ran He, Zhenan Sun
We interpolate training samples at the feature level and propose a novel content loss based on the perceptual relations among samples.
2 code implementations • ICCV 2021 • Hongwen Zhang, Yating Tian, Xinchi Zhou, Wanli Ouyang, Yebin Liu, LiMin Wang, Zhenan Sun
Regression-based methods have recently shown promising results in reconstructing human meshes from monocular images.
Ranked #5 on 3D Human Pose Estimation on AGORA (using extra training data)
3D human pose and shape estimation 3D Human Reconstruction +2
no code implementations • 19 Nov 2020 • Yunfan Liu, Qi Li, Zhenan Sun, Tieniu Tan
Generative Adversarial Networks (GANs) with style-based generators (e. g. StyleGAN) successfully enable semantic control over image synthesis, and recent studies have also revealed that interpretable image translations could be obtained by modifying the latent code.
no code implementations • 19 Nov 2020 • Kunbo Zhang, Zhenteng Shen, Yunlong Wang, Zhenan Sun
In this study, we develop a novel all-in-focus iris imaging system using a focus-tunable lens and a 2D steering mirror to greatly extend capture volume by spatiotemporal multiplexing method.
1 code implementation • 1 Sep 2020 • Leyuan Wang, Kunbo Zhang, Min Ren, Yunlong Wang, Zhenan Sun
The quality metric proposed in this paper can significantly improve the performance of the recognition algorithm while reducing the number of images discarded for recognition, which is advantageous over hand-crafted factors based iris quality assessment methods.
no code implementations • 19 Aug 2020 • Boqiang Xu, Lingxiao He, Xingyu Liao, Wu Liu, Zhenan Sun, Tao Mei
Given the input person image, the ensemble method would focus on the head-shoulder feature by assigning a larger weight if the individual insides the image is in black clothing.
no code implementations • 3 Jun 2020 • Qiyao Deng, Jie Cao, Yunfan Liu, Zhenhua Chai, Qi Li, Zhenan Sun
Face portrait editing has achieved great progress in recent years.
no code implementations • 18 Mar 2020 • Yu Tian, Kunbo Zhang, Leyuan Wang, Zhenan Sun
Extensive experiments demonstrate the advantages of the PAAS technique to counter diverse face spoofing attacks (print, replay, mask) in uncontrolled indoor and outdoor conditions by learning polarized face images of 33 people.
no code implementations • 20 Jan 2020 • Jie Gui, Zhenan Sun, Yonggang Wen, DaCheng Tao, Jieping Ye
Generative adversarial networks (GANs) are a hot research topic recently.
no code implementations • ECCV 2020 • Jie Cao, Huaibo Huang, Yi Li, Ran He, Zhenan Sun
The performance of multi-domain image-to-image translation has been significantly improved by recent progress in deep generative models.
1 code implementation • 31 Dec 2019 • Hongwen Zhang, Jie Cao, Guo Lu, Wanli Ouyang, Zhenan Sun
Reconstructing 3D human shape and pose from monocular images is challenging despite the promising results achieved by the most recent learning-based methods.
Ranked #76 on 3D Human Pose Estimation on 3DPW (MPJPE metric)
3D human pose and shape estimation 3D Human Reconstruction +3
2 code implementations • 1 Dec 2019 • Min Ren, Yunlong Wang, Zhenan Sun, Tieniu Tan
During dynamic graph matching, we propose a novel strategy to measure the distances of both nodes and adjacent matrixes.
no code implementations • 1 Dec 2019 • Min Ren, Caiyong Wang, Yunlong Wang, Zhenan Sun, Tieniu Tan
And illumination variations may cause irregular distortion of iris texture.
no code implementations • 15 Nov 2019 • Yunfan Liu, Qi Li, Zhenan Sun, Tieniu Tan
Face aging, which aims at aesthetically rendering a given face to predict its future appearance, has received significant research attention in recent years.
1 code implementation • IEEE Transactions on Image Processing 2019 • Hongwen Zhang, Qi Li, Zhenan Sun
Then, an end-to-end pipeline is designed to jointly regress the proposed volumetric representation and the coordinate vector.
Ranked #3 on Face Alignment on AFLW2000-3D
no code implementations • 14 Apr 2019 • Jie Cao, Huaibo Huang, Yi Li, Jingtuo Liu, Ran He, Zhenan Sun
In this work, we present a novel training framework for GANs, namely biphasic learning, to achieve image-to-image translation in multiple visual domains at $1024^2$ resolution.
no code implementations • ICCV 2019 • Lingxiao He, Yinggang Wang, Wu Liu, Xingyu Liao, He Zhao, Zhenan Sun, Jiashi Feng
FPR uses the error from robust reconstruction over spatial pyramid features to measure similarities between two persons.
no code implementations • 7 Apr 2019 • Jie Gui, Tongliang Liu, Zhenan Sun, DaCheng Tao, Tieniu Tan
Rather than adopting this method, FSDH uses a very simple yet effective regression of the class labels of training examples to the corresponding hash code to accelerate the algorithm.
no code implementations • 7 Apr 2019 • Jie Gui, Tongliang Liu, Zhenan Sun, DaCheng Tao, Tieniu Tan
In SDHR, the regression target is instead optimized.
no code implementations • 30 Mar 2019 • Pei-Pei Li, Huaibo Huang, Yibo Hu, Xiang Wu, Ran He, Zhenan Sun
UVA is the first attempt to achieve facial age analysis tasks, including age translation, age generation and age estimation, in a universal framework.
no code implementations • 30 Mar 2019 • Pei-Pei Li, Xiang Wu, Yibo Hu, Ran He, Zhenan Sun
In this paper, a new large-scale Multi-yaw Multi-pitch high-quality database is proposed for Facial Pose Analysis (M2FPA), including face frontalization, face rotation, facial pose estimation and pose-invariant face recognition.
no code implementations • 6 Mar 2019 • Qi Li, Yunfan Liu, Zhenan Sun
Age progression and regression refers to aesthetically render-ing a given face image to present effects of face aging and rejuvenation, respectively.
no code implementations • 10 Feb 2019 • Ran He, Jie Cao, Lingxiao Song, Zhenan Sun, Tieniu Tan
This paper models high resolution heterogeneous face synthesis as a complementary combination of two components, a texture inpainting component and pose correction component.
1 code implementation • 31 Jan 2019 • Caiyong Wang, Yuhao Zhu, Yunfan Liu, Ran He, Zhenan Sun
In this paper, we propose a deep multi-task learning framework, named as IrisParseNet, to exploit the inherent correlations between pupil, iris and sclera to boost up the performance of iris segmentation and localization in a unified model.
Ranked #1 on Iris Segmentation on CASIA
1 code implementation • 17 Oct 2018 • Lingxiao He, Zhenan Sun, Yuhao Zhu, Yunbo Wang
Biometric recognition on partial captured targets is challenging, where only several partial observations of objects are available for matching.
no code implementations • 20 Sep 2018 • Pei-Pei Li, Yibo Hu, Ran He, Zhenan Sun
Inspired by the biological evolutionary mechanism, we propose a Coupled Evolutionary Network (CEN) with two concurrent evolutionary processes: evolutionary label distribution learning and evolutionary slack regression.
no code implementations • 20 Sep 2018 • Pei-Pei Li, Yibo Hu, Ran He, Zhenan Sun
%Moreover, to achieve accurate age generation under the premise of preserving the identity information, age estimation network and face verification network are employed.
no code implementations • CVPR 2019 • Yunfan Liu, Qi Li, Zhenan Sun
Since it is difficult to collect face images of the same subject over a long range of age span, most existing face aging methods resort to unpaired datasets to learn age mappings.
no code implementations • 6 Sep 2018 • Xiang Wu, Huaibo Huang, Vishal M. Patel, Ran He, Zhenan Sun
Visible (VIS) to near infrared (NIR) face matching is a challenging problem due to the significant domain discrepancy between the domains and a lack of sufficient data for training cross-modal matching algorithms.
Ranked #2 on Face Verification on BUAA-VisNir
no code implementations • ECCV 2018 • Yunlong Wang, Fei Liu, Zilei Wang, Guangqi Hou, Zhenan Sun, Tieniu Tan
Limited angular resolution has become the main bottleneck of microlens-based plenoptic cameras towards practical vision applications.
3 code implementations • NeurIPS 2018 • Huaibo Huang, Zhihang Li, Ran He, Zhenan Sun, Tieniu Tan
On the other hand, the inference model is encouraged to classify between the generated and real samples while the generator tries to fool it as GANs.
no code implementations • 11 Jul 2018 • Huaibo Huang, Lingxiao Song, Ran He, Zhenan Sun, Tieniu Tan
Variational capsules model an image as a composition of entities in a probabilistic model.
no code implementations • NeurIPS 2018 • Jie Cao, Yibo Hu, Hongwen Zhang, Ran He, Zhenan Sun
We decompose the prerequisite of warping into dense correspondence field estimation and facial texture map recovering, which are both well addressed by deep networks.
no code implementations • CVPR 2018 • Lingxiao He, Haiqing Li, Qi Zhang, Zhenan Sun
Partial face recognition (PFR) in unconstrained environment is a very important task, especially in video surveillance, mobile devices, etc.
no code implementations • CVPR 2018 • Yibo Hu, Xiang Wu, Bing Yu, Ran He, Zhenan Sun
Face rotation provides an effective and cheap way for data augmentation and representation learning of face recognition.
no code implementations • 21 Feb 2018 • Jie Cao, Yibo Hu, Bing Yu, Ran He, Zhenan Sun
Multi-view face synthesis from a single image is an ill-posed problem and often suffers from serious appearance distortion.
no code implementations • 28 Jan 2018 • Hongwen Zhang, Qi Li, Zhenan Sun
Then, a stacked hourglass network is adopted to estimate the volumetric representation from coarse to fine, followed by a 3D convolution network that takes the estimated volume as input and regresses 3D coordinates of the face shape.
Ranked #1 on 3D Facial Landmark Localization on AFLW2000-3D
no code implementations • 25 Jan 2018 • Pei-Pei Li, Yibo Hu, Qi Li, Ran He, Zhenan Sun
To utilize both global and local facial information, we propose a Global and Local Consistent Age Generative Adversarial Network (GLCA-GAN).
1 code implementation • CVPR 2018 • Lingxiao He, Jian Liang, Haiqing Li, Zhenan Sun
Experimental results on two partial person datasets demonstrate the efficiency and effectiveness of the proposed method in comparison with several state-of-the-art partial person re-id approaches.
no code implementations • 10 Dec 2017 • Lingxiao Song, Zhihe Lu, Ran He, Zhenan Sun, Tieniu Tan
An expression invariant face recognition experiment is also performed to further show the advantages of our proposed method.
no code implementations • ICCV 2017 • Huaibo Huang, Ran He, Zhenan Sun, Tieniu Tan
Most modern face super-resolution methods resort to convolutional neural networks (CNN) to infer high-resolution (HR) face images.
Ranked #3 on Face Hallucination on FFHQ 512 x 512 - 16x upscaling
no code implementations • 8 Aug 2017 • Ran He, Xiang Wu, Zhenan Sun, Tieniu Tan
To avoid the over-fitting problem on small-scale heterogeneous face data, a correlation prior is introduced on the fully-connected layers of WCNN network to reduce parameter space.
Ranked #3 on Face Verification on BUAA-VisNir
no code implementations • 15 Jun 2017 • Zhihe Lu, Zhihang Li, Jie Cao, Ran He, Zhenan Sun
Face synthesis has been a fascinating yet challenging problem in computer vision and machine learning.
no code implementations • NeurIPS 2017 • Qi Li, Zhenan Sun, Ran He, Tieniu Tan
Benefit from recent advances in deep learning, deep hashing methods have achieved promising results for image retrieval.
1 code implementation • 30 Nov 2016 • Hongwen Zhang, Qi Li, Zhenan Sun, Yunfan Liu
This Estimation-Correction-Tuning process perfectly combines the advantages of the global robustness of data-driven method (FCN), outlier correction capability of model-driven method (PDM) and non-parametric optimization of RLMS.
16 code implementations • 9 Nov 2015 • Xiang Wu, Ran He, Zhenan Sun, Tieniu Tan
This paper presents a Light CNN framework to learn a compact embedding on the large-scale face data with massive noisy labels.
Ranked #2 on Age-Invariant Face Recognition on CAFR
no code implementations • 9 Jul 2015 • Ran He, Tieniu Tan, Larry Davis, Zhenan Sun
This paper presents a structured ordinal measure method for video-based face recognition that simultaneously learns ordinal filters and structured ordinal features.