Search Results for author: Zhenan Sun

Found 75 papers, 26 papers with code

Hierarchical Face Aging through Disentangled Latent Characteristics

no code implementations ECCV 2020 Pei-Pei Li, Huaibo Huang, Yibo Hu, Xiang Wu, Ran He, Zhenan Sun

To explore the age effects on facial images, we propose a Disentangled Adversarial Autoencoder (DAAE) to disentangle the facial images into three independent factors: age, identity and extraneous information.

Age Estimation MORPH

MoPE-CLIP: Structured Pruning for Efficient Vision-Language Models with Module-wise Pruning Error Metric

no code implementations12 Mar 2024 Haokun Lin, Haoli Bai, Zhili Liu, Lu Hou, Muyi Sun, Linqi Song, Ying WEI, Zhenan Sun

We find that directly using smaller pre-trained models and applying magnitude-based pruning on CLIP models leads to inflexibility and inferior performance.

DFGC-VRA: DeepFake Game Competition on Visual Realism Assessment

1 code implementation journal 2023 Bo Peng, Xianyun Sun, Caiyong Wang, Wei Wang1, Jing Dong, Zhenan Sun

This paper presents the summary report on the DeepFake Game Competition on Visual Realism Assessment (DFGCVRA).

Face Swapping

Learning Explicit Contact for Implicit Reconstruction of Hand-held Objects from Monocular Images

no code implementations31 May 2023 Junxing Hu, Hongwen Zhang, Zerui Chen, Mengcheng Li, Yunlong Wang, Yebin Liu, Zhenan Sun

In the second part, we introduce a novel method to diffuse estimated contact states from the hand mesh surface to nearby 3D space and leverage diffused contact probabilities to construct the implicit neural representation for the manipulated object.

Object

CASIA-Iris-Africa: A Large-scale African Iris Image Database

no code implementations25 Feb 2023 Jawad Muhammad, Yunlong Wang, Junxing Hu, Kunbo Zhang, Zhenan Sun

The database contains 28, 717 images of 1023 African subjects (2046 iris classes) with age, gender, and ethnicity attributes that can be useful in demographically sensitive studies of Africans.

Iris Recognition

A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends

1 code implementation13 Jan 2023 Jie Gui, Tuo Chen, Jing Zhang, Qiong Cao, Zhenan Sun, Hao Luo, DaCheng Tao

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance.

Self-Supervised Learning

Learning Feature Recovery Transformer for Occluded Person Re-identification

1 code implementation5 Jan 2023 Boqiang Xu, Lingxiao He, Jian Liang, Zhenan Sun

To reduce the interference of the noise during feature matching, we mainly focus on visible regions that appear in both images and develop a visibility graph to calculate the similarity.

Graph Matching Graph Similarity +1

Semantic-aware One-shot Face Re-enactment with Dense Correspondence Estimation

no code implementations23 Nov 2022 Yunfan Liu, Qi Li, Zhenan Sun, Tieniu Tan

One-shot face re-enactment is a challenging task due to the identity mismatch between source and driving faces.

Disentanglement Generative Adversarial Network

GAN-based Facial Attribute Manipulation

no code implementations23 Oct 2022 Yunfan Liu, Qi Li, Qiyao Deng, Zhenan Sun, Ming-Hsuan Yang

Facial Attribute Manipulation (FAM) aims to aesthetically modify a given face image to render desired attributes, which has received significant attention due to its broad practical applications ranging from digital entertainment to biometric forensics.

Attribute

Exploring Generalizable Distillation for Efficient Medical Image Segmentation

1 code implementation26 Jul 2022 Xingqun Qi, Zhuojie Wu, Min Ren, Muyi Sun, Caifeng Shan, Zhenan Sun

Considering the domain-invariant representative vectors in MSAN, we propose two generalizable knowledge distillation schemes for cross-domain distillation, Dual Contrastive Graph Distillation (DCGD) and Domain-Invariant Cross Distillation (DICD).

Image Segmentation Knowledge Distillation +3

Perturbation Inactivation Based Adversarial Defense for Face Recognition

1 code implementation13 Jul 2022 Min Ren, Yuhao Zhu, Yunlong Wang, Zhenan Sun

A straightforward approach is to inactivate the adversarial perturbations so that they can be easily handled as general perturbations.

Adversarial Attack Adversarial Defense +1

PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Images

1 code implementation13 Jul 2022 Hongwen Zhang, Yating Tian, Yuxiang Zhang, Mengcheng Li, Liang An, Zhenan Sun, Yebin Liu

To address these issues, we propose a Pyramidal Mesh Alignment Feedback (PyMAF) loop in our regression network for well-aligned human mesh recovery and extend it as PyMAF-X for the recovery of expressive full-body models.

Ranked #6 on 3D Human Pose Estimation on AGORA (using extra training data)

3D human pose and shape estimation Human Mesh Recovery +2

Disentangled Federated Learning for Tackling Attributes Skew via Invariant Aggregation and Diversity Transferring

no code implementations14 Jun 2022 Zhengquan Luo, Yunlong Wang, Zilei Wang, Zhenan Sun, Tieniu Tan

Attributes skew hinders the current federated learning (FL) frameworks from consistent optimization directions among the clients, which inevitably leads to performance reduction and unstable convergence.

Federated Learning valid

ShowFace: Coordinated Face Inpainting with Memory-Disentangled Refinement Networks

no code implementations6 Apr 2022 Zhuojie Wu, Xingqun Qi, Zijian Wang, Wanting Zhou, Kun Yuan, Muyi Sun, Zhenan Sun

Furthermore, to better improve the inter-coordination between the corrupted and non-corrupted regions and enhance the intra-coordination in corrupted regions, we design InCo2 Loss, a pair of similarity based losses to constrain the feature consistency.

Disentanglement Facial Inpainting

AnyFace: Free-style Text-to-Face Synthesis and Manipulation

no code implementations CVPR 2022 Jianxin Sun, Qiyao Deng, Qi Li, Muyi Sun, Min Ren, Zhenan Sun

AnyFace can achieve high-quality, high-resolution, and high-diversity face synthesis and manipulation results without any constraints on the number and content of input captions.

Face Generation Image Reconstruction +1

Learning Disentangled Representation for One-shot Progressive Face Swapping

1 code implementation24 Mar 2022 Qi Li, Weining Wang, Chengzhong Xu, Zhenan Sun

In addition, semantic information is introduced into the semantic-guided fusion module to control the swapped area and model the pose and expression more accurately.

Attribute Disentanglement +1

MOST-Net: A Memory Oriented Style Transfer Network for Face Sketch Synthesis

no code implementations8 Feb 2022 Fan Ji, Muyi Sun, Xingqun Qi, Qi Li, Zhenan Sun

Furthermore, we design a novel Memory Refinement Loss (MR Loss) for feature alignment in the memory module, which enhances the accuracy of memory slots in an unsupervised manner.

Face Sketch Synthesis Image-to-Image Translation +2

Mimic Embedding via Adaptive Aggregation: Learning Generalizable Person Re-identification

1 code implementation16 Dec 2021 Boqiang Xu, Jian Liang, Lingxiao He, Zhenan Sun

Meanwhile, META considers the relevance of an unseen target sample and source domains via normalization statistics and develops an aggregation module to adaptively integrate multiple experts for mimicking unseen target domain.

Generalizable Person Re-identification

Toward Accurate and Reliable Iris Segmentation Using Uncertainty Learning

no code implementations20 Oct 2021 Jianze Wei, Huaibo Huang, Muyi Sun, Yunlong Wang, Min Ren, Ran He, Zhenan Sun

To make further efforts on accurate and reliable iris segmentation, we propose a bilateral self-attention module and design Bilateral Transformer (BiTrans) with hierarchical architecture by exploring spatial and visual relationships.

Iris Recognition Iris Segmentation +1

An End-to-End Autofocus Camera for Iris on the Move

1 code implementation29 Jun 2021 Leyuan Wang, Kunbo Zhang, Yunlong Wang, Zhenan Sun

To accommodate users at different distances, it is necessary to control focus quickly and accurately.

Iris Recognition

One Shot Face Swapping on Megapixels

1 code implementation CVPR 2021 Yuhao Zhu, Qi Li, Jian Wang, Chengzhong Xu, Zhenan Sun

Extensive experiments demonstrate the superiority of MegaFS and the first megapixel level face swapping database is released for research on DeepFake detection and face image editing in the public domain.

DeepFake Detection Disentanglement +2

CASIA-Face-Africa: A Large-scale African Face Image Database

no code implementations8 May 2021 Jawad Muhammad, Yunlong Wang, Caiyong Wang, Kunbo Zhang, Zhenan Sun

The proposed database along with its face landmark annotations, evaluation protocols and preliminary results form a good benchmark to study the essential aspects of face biometrics for African subjects, especially face image preprocessing, face feature analysis and matching, facial expression recognition, sex/age estimation, ethnic classification, face image generation, etc.

Age Estimation Face Recognition +3

ReMix: Towards Image-to-Image Translation with Limited Data

1 code implementation CVPR 2021 Jie Cao, Luanxuan Hou, Ming-Hsuan Yang, Ran He, Zhenan Sun

We interpolate training samples at the feature level and propose a novel content loss based on the perceptual relations among samples.

Data Augmentation Image-to-Image Translation +1

Style Intervention: How to Achieve Spatial Disentanglement with Style-based Generators?

no code implementations19 Nov 2020 Yunfan Liu, Qi Li, Zhenan Sun, Tieniu Tan

Generative Adversarial Networks (GANs) with style-based generators (e. g. StyleGAN) successfully enable semantic control over image synthesis, and recent studies have also revealed that interpretable image translations could be obtained by modifying the latent code.

Attribute Disentanglement +2

All-in-Focus Iris Camera With a Great Capture Volume

no code implementations19 Nov 2020 Kunbo Zhang, Zhenteng Shen, Yunlong Wang, Zhenan Sun

In this study, we develop a novel all-in-focus iris imaging system using a focus-tunable lens and a 2D steering mirror to greatly extend capture volume by spatiotemporal multiplexing method.

Iris Recognition

Recognition Oriented Iris Image Quality Assessment in the Feature Space

1 code implementation1 Sep 2020 Leyuan Wang, Kunbo Zhang, Min Ren, Yunlong Wang, Zhenan Sun

The quality metric proposed in this paper can significantly improve the performance of the recognition algorithm while reducing the number of images discarded for recognition, which is advantageous over hand-crafted factors based iris quality assessment methods.

Image Quality Assessment

Black Re-ID: A Head-shoulder Descriptor for the Challenging Problem of Person Re-Identification

no code implementations19 Aug 2020 Boqiang Xu, Lingxiao He, Xingyu Liao, Wu Liu, Zhenan Sun, Tao Mei

Given the input person image, the ensemble method would focus on the head-shoulder feature by assigning a larger weight if the individual insides the image is in black clothing.

Person Re-Identification

Face Anti-Spoofing by Learning Polarization Cues in a Real-World Scenario

no code implementations18 Mar 2020 Yu Tian, Kunbo Zhang, Leyuan Wang, Zhenan Sun

Extensive experiments demonstrate the advantages of the PAAS technique to counter diverse face spoofing attacks (print, replay, mask) in uncontrolled indoor and outdoor conditions by learning polarized face images of 33 people.

Face Anti-Spoofing

Informative Sample Mining Network for Multi-Domain Image-to-Image Translation

no code implementations ECCV 2020 Jie Cao, Huaibo Huang, Yi Li, Ran He, Zhenan Sun

The performance of multi-domain image-to-image translation has been significantly improved by recent progress in deep generative models.

Image-to-Image Translation Informativeness +1

Learning 3D Human Shape and Pose from Dense Body Parts

1 code implementation31 Dec 2019 Hongwen Zhang, Jie Cao, Guo Lu, Wanli Ouyang, Zhenan Sun

Reconstructing 3D human shape and pose from monocular images is challenging despite the promising results achieved by the most recent learning-based methods.

Ranked #76 on 3D Human Pose Estimation on 3DPW (MPJPE metric)

3D human pose and shape estimation 3D Human Reconstruction +3

Dynamic Graph Representation for Partially Occluded Biometrics

2 code implementations1 Dec 2019 Min Ren, Yunlong Wang, Zhenan Sun, Tieniu Tan

During dynamic graph matching, we propose a novel strategy to measure the distances of both nodes and adjacent matrixes.

Graph Matching

A3GAN: An Attribute-aware Attentive Generative Adversarial Network for Face Aging

no code implementations15 Nov 2019 Yunfan Liu, Qi Li, Zhenan Sun, Tieniu Tan

Face aging, which aims at aesthetically rendering a given face to predict its future appearance, has received significant research attention in recent years.

Attribute Generative Adversarial Network

Biphasic Learning of GANs for High-Resolution Image-to-Image Translation

no code implementations14 Apr 2019 Jie Cao, Huaibo Huang, Yi Li, Jingtuo Liu, Ran He, Zhenan Sun

In this work, we present a novel training framework for GANs, namely biphasic learning, to achieve image-to-image translation in multiple visual domains at $1024^2$ resolution.

Image-to-Image Translation Mutual Information Estimation +2

Fast Supervised Discrete Hashing

no code implementations7 Apr 2019 Jie Gui, Tongliang Liu, Zhenan Sun, DaCheng Tao, Tieniu Tan

Rather than adopting this method, FSDH uses a very simple yet effective regression of the class labels of training examples to the corresponding hash code to accelerate the algorithm.

regression

UVA: A Universal Variational Framework for Continuous Age Analysis

no code implementations30 Mar 2019 Pei-Pei Li, Huaibo Huang, Yibo Hu, Xiang Wu, Ran He, Zhenan Sun

UVA is the first attempt to achieve facial age analysis tasks, including age translation, age generation and age estimation, in a universal framework.

Age Estimation MORPH +1

M2FPA: A Multi-Yaw Multi-Pitch High-Quality Database and Benchmark for Facial Pose Analysis

no code implementations30 Mar 2019 Pei-Pei Li, Xiang Wu, Yibo Hu, Ran He, Zhenan Sun

In this paper, a new large-scale Multi-yaw Multi-pitch high-quality database is proposed for Facial Pose Analysis (M2FPA), including face frontalization, face rotation, facial pose estimation and pose-invariant face recognition.

Attribute Face Generation +3

Age Progression and Regression with Spatial Attention Modules

no code implementations6 Mar 2019 Qi Li, Yunfan Liu, Zhenan Sun

Age progression and regression refers to aesthetically render-ing a given face image to present effects of face aging and rejuvenation, respectively.

regression Translation

Cross-spectral Face Completion for NIR-VIS Heterogeneous Face Recognition

no code implementations10 Feb 2019 Ran He, Jie Cao, Lingxiao Song, Zhenan Sun, Tieniu Tan

This paper models high resolution heterogeneous face synthesis as a complementary combination of two components, a texture inpainting component and pose correction component.

Face Generation Face Recognition +3

Joint Iris Segmentation and Localization Using Deep Multi-task Learning Framework

1 code implementation31 Jan 2019 Caiyong Wang, Yuhao Zhu, Yunfan Liu, Ran He, Zhenan Sun

In this paper, we propose a deep multi-task learning framework, named as IrisParseNet, to exploit the inherent correlations between pupil, iris and sclera to boost up the performance of iris segmentation and localization in a unified model.

Iris Segmentation Multi-Task Learning +1

Recognizing Partial Biometric Patterns

1 code implementation17 Oct 2018 Lingxiao He, Zhenan Sun, Yuhao Zhu, Yunbo Wang

Biometric recognition on partial captured targets is challenging, where only several partial observations of objects are available for matching.

Dictionary Learning Face Recognition +1

A Coupled Evolutionary Network for Age Estimation

no code implementations20 Sep 2018 Pei-Pei Li, Yibo Hu, Ran He, Zhenan Sun

Inspired by the biological evolutionary mechanism, we propose a Coupled Evolutionary Network (CEN) with two concurrent evolutionary processes: evolutionary label distribution learning and evolutionary slack regression.

Age Estimation MORPH +1

Global and Local Consistent Wavelet-domain Age Synthesis

no code implementations20 Sep 2018 Pei-Pei Li, Yibo Hu, Ran He, Zhenan Sun

%Moreover, to achieve accurate age generation under the premise of preserving the identity information, age estimation network and face verification network are employed.

Age Estimation Face Verification +3

Attribute-aware Face Aging with Wavelet-based Generative Adversarial Networks

no code implementations CVPR 2019 Yunfan Liu, Qi Li, Zhenan Sun

Since it is difficult to collect face images of the same subject over a long range of age span, most existing face aging methods resort to unpaired datasets to learn age mappings.

Attribute

Disentangled Variational Representation for Heterogeneous Face Recognition

no code implementations6 Sep 2018 Xiang Wu, Huaibo Huang, Vishal M. Patel, Ran He, Zhenan Sun

Visible (VIS) to near infrared (NIR) face matching is a challenging problem due to the significant domain discrepancy between the domains and a lack of sufficient data for training cross-modal matching algorithms.

Face Recognition Heterogeneous Face Recognition

End-to-end View Synthesis for Light Field Imaging with Pseudo 4DCNN

no code implementations ECCV 2018 Yunlong Wang, Fei Liu, Zilei Wang, Guangqi Hou, Zhenan Sun, Tieniu Tan

Limited angular resolution has become the main bottleneck of microlens-based plenoptic cameras towards practical vision applications.

Computational Efficiency Depth Estimation

IntroVAE: Introspective Variational Autoencoders for Photographic Image Synthesis

3 code implementations NeurIPS 2018 Huaibo Huang, Zhihang Li, Ran He, Zhenan Sun, Tieniu Tan

On the other hand, the inference model is encouraged to classify between the generated and real samples while the generator tries to fool it as GANs.

Image Generation

Learning a High Fidelity Pose Invariant Model for High-resolution Face Frontalization

no code implementations NeurIPS 2018 Jie Cao, Yibo Hu, Hongwen Zhang, Ran He, Zhenan Sun

We decompose the prerequisite of warping into dense correspondence field estimation and facial texture map recovering, which are both well addressed by deep networks.

Dictionary Learning Face Recognition +2

Dynamic Feature Learning for Partial Face Recognition

no code implementations CVPR 2018 Lingxiao He, Haiqing Li, Qi Zhang, Zhenan Sun

Partial face recognition (PFR) in unconstrained environment is a very important task, especially in video surveillance, mobile devices, etc.

Face Recognition

Pose-Guided Photorealistic Face Rotation

no code implementations CVPR 2018 Yibo Hu, Xiang Wu, Bing Yu, Ran He, Zhenan Sun

Face rotation provides an effective and cheap way for data augmentation and representation learning of face recognition.

Data Augmentation Face Recognition +2

Load Balanced GANs for Multi-view Face Image Synthesis

no code implementations21 Feb 2018 Jie Cao, Yibo Hu, Bing Yu, Ran He, Zhenan Sun

Multi-view face synthesis from a single image is an ill-posed problem and often suffers from serious appearance distortion.

Face Generation

Joint Voxel and Coordinate Regression for Accurate 3D Facial Landmark Localization

no code implementations28 Jan 2018 Hongwen Zhang, Qi Li, Zhenan Sun

Then, a stacked hourglass network is adopted to estimate the volumetric representation from coarse to fine, followed by a 3D convolution network that takes the estimated volume as input and regresses 3D coordinates of the face shape.

3D Facial Landmark Localization Depth Estimation +2

Global and Local Consistent Age Generative Adversarial Networks

no code implementations25 Jan 2018 Pei-Pei Li, Yibo Hu, Qi Li, Ran He, Zhenan Sun

To utilize both global and local facial information, we propose a Global and Local Consistent Age Generative Adversarial Network (GLCA-GAN).

Attribute Generative Adversarial Network +2

Deep Spatial Feature Reconstruction for Partial Person Re-identification: Alignment-Free Approach

1 code implementation CVPR 2018 Lingxiao He, Jian Liang, Haiqing Li, Zhenan Sun

Experimental results on two partial person datasets demonstrate the efficiency and effectiveness of the proposed method in comparison with several state-of-the-art partial person re-id approaches.

Dictionary Learning Person Re-Identification

Geometry Guided Adversarial Facial Expression Synthesis

no code implementations10 Dec 2017 Lingxiao Song, Zhihe Lu, Ran He, Zhenan Sun, Tieniu Tan

An expression invariant face recognition experiment is also performed to further show the advantages of our proposed method.

Face Recognition Face Transfer +2

Wasserstein CNN: Learning Invariant Features for NIR-VIS Face Recognition

no code implementations8 Aug 2017 Ran He, Xiang Wu, Zhenan Sun, Tieniu Tan

To avoid the over-fitting problem on small-scale heterogeneous face data, a correlation prior is introduced on the fully-connected layers of WCNN network to reduce parameter space.

Face Recognition Heterogeneous Face Recognition

Recent Progress of Face Image Synthesis

no code implementations15 Jun 2017 Zhihe Lu, Zhihang Li, Jie Cao, Ran He, Zhenan Sun

Face synthesis has been a fascinating yet challenging problem in computer vision and machine learning.

Face Generation Face Recognition

Deep Supervised Discrete Hashing

no code implementations NeurIPS 2017 Qi Li, Zhenan Sun, Ran He, Tieniu Tan

Benefit from recent advances in deep learning, deep hashing methods have achieved promising results for image retrieval.

Deep Hashing General Classification +1

Combining Data-driven and Model-driven Methods for Robust Facial Landmark Detection

1 code implementation30 Nov 2016 Hongwen Zhang, Qi Li, Zhenan Sun, Yunfan Liu

This Estimation-Correction-Tuning process perfectly combines the advantages of the global robustness of data-driven method (FCN), outlier correction capability of model-driven method (PDM) and non-parametric optimization of RLMS.

Facial Landmark Detection

A Light CNN for Deep Face Representation with Noisy Labels

16 code implementations9 Nov 2015 Xiang Wu, Ran He, Zhenan Sun, Tieniu Tan

This paper presents a Light CNN framework to learn a compact embedding on the large-scale face data with massive noisy labels.

Face Identification Face Recognition +2

Learning Structured Ordinal Measures for Video based Face Recognition

no code implementations9 Jul 2015 Ran He, Tieniu Tan, Larry Davis, Zhenan Sun

This paper presents a structured ordinal measure method for video-based face recognition that simultaneously learns ordinal filters and structured ordinal features.

Face Recognition

Cannot find the paper you are looking for? You can Submit a new open access paper.