Search Results for author: Hongyi Xu

Found 21 papers, 9 papers with code

X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attention

no code implementations23 Mar 2024 You Xie, Hongyi Xu, Guoxian Song, Chao Wang, Yichun Shi, Linjie Luo

We propose X-Portrait, an innovative conditional diffusion model tailored for generating expressive and temporally coherent portrait animation.

Disentanglement

DiffPortrait3D: Controllable Diffusion for Zero-Shot Portrait View Synthesis

1 code implementation20 Dec 2023 Yuming Gu, You Xie, Hongyi Xu, Guoxian Song, Yichun Shi, Di Chang, Jing Yang, Linjie Luo

The rendering view is then manipulated with a novel conditional control module that interprets the camera pose by watching a condition image of a crossed subject from the same view.

Denoising

GETAvatar: Generative Textured Meshes for Animatable Human Avatars

no code implementations ICCV 2023 Xuanmeng Zhang, Jianfeng Zhang, Rohan Chacko, Hongyi Xu, Guoxian Song, Yi Yang, Jiashi Feng

We study the problem of 3D-aware full-body human generation, aiming at creating animatable human avatars with high-quality textures and geometries.

Image Generation

An interpretable deep learning method for bearing fault diagnosis

no code implementations20 Aug 2023 Hao Lu, Austin M. Bray, Chao Hu, Andrew T. Zimmerman, Hongyi Xu

During the model evaluation process, the proposed approach retrieves prediction basis samples from the health library according to the similarity of the feature importance.

Feature Importance

OmniAvatar: Geometry-Guided Controllable 3D Head Synthesis

no code implementations CVPR 2023 Hongyi Xu, Guoxian Song, Zihang Jiang, Jianfeng Zhang, Yichun Shi, Jing Liu, WanChun Ma, Jiashi Feng, Linjie Luo

We present OmniAvatar, a novel geometry-guided 3D head synthesis model trained from in-the-wild unstructured images that is capable of synthesizing diverse identity-preserved 3D heads with compelling dynamic details under full disentangled control over camera poses, facial expressions, head shapes, articulated neck and jaw poses.

AgileGAN3D: Few-Shot 3D Portrait Stylization by Augmented Transfer Learning

no code implementations24 Mar 2023 Guoxian Song, Hongyi Xu, Jing Liu, Tiancheng Zhi, Yichun Shi, Jianfeng Zhang, Zihang Jiang, Jiashi Feng, Shen Sang, Linjie Luo

Capitalizing on the recent advancement of 3D-aware GAN models, we perform \emph{guided transfer learning} on a pretrained 3D GAN generator to produce multi-view-consistent stylized renderings.

Transfer Learning

PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360$^{\circ}$

1 code implementation23 Mar 2023 Sizhe An, Hongyi Xu, Yichun Shi, Guoxian Song, Umit Ogras, Linjie Luo

We propose PanoHead, the first 3D-aware generative model that enables high-quality view-consistent image synthesis of full heads in $360^\circ$ with diverse appearance and detailed geometry using only in-the-wild unstructured images for training.

Image Generation Image Segmentation +1

PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360deg

1 code implementation CVPR 2023 Sizhe An, Hongyi Xu, Yichun Shi, Guoxian Song, Umit Y. Ogras, Linjie Luo

We propose PanoHead, the first 3D-aware generative model that enables high-quality view-consistent image synthesis of full heads in 360deg with diverse appearance and detailed geometry using only in-the-wild unstructured images for training.

Image Generation Image Segmentation +1

AvatarGen: A 3D Generative Model for Animatable Human Avatars

1 code implementation26 Nov 2022 Jianfeng Zhang, Zihang Jiang, Dingdong Yang, Hongyi Xu, Yichun Shi, Guoxian Song, Zhongcong Xu, Xinchao Wang, Jiashi Feng

Specifically, we decompose the generative 3D human synthesis into pose-guided mapping and canonical representation with predefined human pose and shape, such that the canonical representation can be explicitly driven to different poses and shapes with the guidance of a 3D parametric human model SMPL.

AvatarGen: a 3D Generative Model for Animatable Human Avatars

1 code implementation1 Aug 2022 Jianfeng Zhang, Zihang Jiang, Dingdong Yang, Hongyi Xu, Yichun Shi, Guoxian Song, Zhongcong Xu, Xinchao Wang, Jiashi Feng

Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications.

3D Human Reconstruction

Feature Generation and Hypothesis Verification for Reliable Face Anti-Spoofing

1 code implementation30 Dec 2021 Shice Liu, Shitao Lu, Hongyi Xu, Jing Yang, Shouhong Ding, Lizhuang Ma

However, the improvement is still limited by two issues: 1) It is difficult to perfectly map all faces to a shared feature space.

Disentanglement Domain Generalization +1

imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Pose

1 code implementation ICCV 2021 Thiemo Alldieck, Hongyi Xu, Cristian Sminchisescu

We present imGHUM, the first holistic generative model of 3D human shape and articulated pose, represented as a signed distance function.

Semi-supervised 3D Object Detection via Adaptive Pseudo-Labeling

no code implementations15 Aug 2021 Hongyi Xu, Fengqi Liu, Qianyu Zhou, Jinkun Hao, Zhijie Cao, Zhengyang Feng, Lizhuang Ma

Inspired by this, we propose a novel semi-supervised framework based on pseudo-labeling for outdoor 3D object detection tasks.

3D Object Detection Object +1

Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flows

no code implementations ECCV 2020 Andrei Zanfir, Eduard Gabriel Bazavan, Hongyi Xu, Bill Freeman, Rahul Sukthankar, Cristian Sminchisescu

Monocular 3D human pose and shape estimation is challenging due to the many degrees of freedom of the human body and thedifficulty to acquire training data for large-scale supervised learning in complex visual scenes.

Ranked #53 on 3D Human Pose Estimation on 3DPW (PA-MPJPE metric)

3D human pose and shape estimation Self-Supervised Learning

Towards cross-platform automated rotation electron diffraction

no code implementations21 Nov 2019 Maria Roslova, Stef Smeets, Bin Wang, Thomas Thersleff, Hongyi Xu, Xiaodong Zou

A DigitalMicrograph script InsteaDMatic has been developed to facilitate rapid automated continuous rotation electron diffraction (cRED) data acquisition.

Materials Science

Cannot find the paper you are looking for? You can Submit a new open access paper.