Search Results for author: Yudong Guo

Found 20 papers, 6 papers with code

HERA: Hybrid Explicit Representation for Ultra-Realistic Head Avatars

no code implementations CVPR 2025 Hongrui Cai, Yuting Xiao, Xuan Wang, Jiafei Li, Yudong Guo, Yanbo Fan, Shenghua Gao, Juyong Zhang

We introduce a novel approach to creating ultra-realistic head avatars and rendering them in real time (\geq 30 fps at 2048 x1334 resolution).

3DGS

One Shot, One Talk: Whole-body Talking Avatar from a Single Image

no code implementations2 Dec 2024 Jun Xiang, Yudong Guo, Leipeng Hu, Boyang Guo, Yancheng Yuan, Juyong Zhang

Building realistic and animatable avatars still requires minutes of multi-view or monocular self-rotating videos, and most methods lack precise control over gestures and expressions.

3DGS

Portrait Video Editing Empowered by Multimodal Generative Priors

no code implementations20 Sep 2024 Xuan Gao, Haiyao Xiao, Chenglai Zhong, Shimin Hu, Yudong Guo, Juyong Zhang

Extensive experiments demonstrate the temporal consistency, editing efficiency, and superior rendering quality of our method.

Video Editing

PICA: Physics-Integrated Clothed Avatar

no code implementations7 Jul 2024 Bo Peng, Yunfan Tao, Haoyu Zhan, Yudong Guo, Juyong Zhang

We introduce PICA, a novel representation for high-fidelity animatable clothed human avatars with physics-accurate dynamics, even for loose clothing.

3DGS Graph Neural Network +1

Hybrid Explicit Representation for Ultra-Realistic Head Avatars

no code implementations18 Mar 2024 Hongrui Cai, Yuting Xiao, Xuan Wang, Jiafei Li, Yudong Guo, Yanbo Fan, Shenghua Gao, Juyong Zhang

We introduce a novel approach to creating ultra-realistic head avatars and rendering them in real-time (>30fps at $2048 \times 1334$ resolution).

3DGS Novel View Synthesis

FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embedding

no code implementations CVPR 2024 Jun Xiang, Xuan Gao, Yudong Guo, Juyong Zhang

We propose FlashAvatar, a novel and lightweight 3D animatable avatar representation that could reconstruct a digital avatar from a short monocular video sequence in minutes and render high-fidelity photo-realistic images at 300FPS on a consumer-grade GPU.

Face Model

CosAvatar: Consistent and Animatable Portrait Video Tuning with Text Prompt

no code implementations30 Nov 2023 Haiyao Xiao, Chenglai Zhong, Xuan Gao, Yudong Guo, Juyong Zhang

Recently, text-guided digital portrait editing has attracted more and more attentions.

NeRF

MetaHead: An Engine to Create Realistic Digital Head

no code implementations3 Apr 2023 Dingyun Zhang, Chenglai Zhong, Yudong Guo, Yang Hong, Juyong Zhang

Experiments validate that our controllable digital head engine achieves the state-of-the-art generation visual quality and reconstruction accuracy.

Diversity Image Generation

Prior-Guided Multi-View 3D Head Reconstruction

no code implementations9 Jul 2021 Xueying Wang, Yudong Guo, Zhongqi Yang, Juyong Zhang

Extensive ablation studies and comparisons with state-of-the-art methods demonstrate that our method can generate high-fidelity 3D head geometries with the guidance of these priors.

Neural Rendering Semantic Segmentation

StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Vision

1 code implementation CVPR 2021 Yang Hong, Juyong Zhang, Boyi Jiang, Yudong Guo, Ligang Liu, Hujun Bao

In this paper, we propose StereoPIFu, which integrates the geometric constraints of stereo vision with implicit function representation of PIFu, to recover the 3D shape of the clothed human from a pair of low-cost rectified images.

AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis

1 code implementation ICCV 2021 Yudong Guo, Keyu Chen, Sen Liang, Yong-Jin Liu, Hujun Bao, Juyong Zhang

Generating high-fidelity talking head video by fitting with the input audio sequence is a challenging problem that receives considerable attentions recently.

NeRF Talking Face Generation

Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model

1 code implementation20 Apr 2020 Hongrui Cai, Yudong Guo, Zhuang Peng, Juyong Zhang

To this end, we first build a dataset with various styles of 2D caricatures and their corresponding 3D shapes, and then build a parametric model on vertex based deformation space for 3D caricature face.

3D Face Reconstruction Caricature +1

Lightweight Photometric Stereo for Facial Details Recovery

1 code implementation CVPR 2020 Xueying Wang, Yudong Guo, Bailin Deng, Juyong Zhang

Recently, 3D face reconstruction from a single image has achieved great success with the help of deep learning and shape prior knowledge, but they often fail to produce accurate geometry details.

3D Face Reconstruction Data Augmentation +1

Semi-supervised 3D Face Reconstruction with Nonlinear Disentangled Representations

no code implementations25 Sep 2019 Zhongpai Gao, Juyong Zhang, Yudong Guo, Chao Ma, Guangtao Zhai, Xiaokang Yang

Moreover, the identity and expression representations are entangled in these models, which hurdles many facial editing applications.

3D Face Reconstruction 3D geometry +1

3D Magic Mirror: Automatic Video to 3D Caricature Translation

no code implementations3 Jun 2019 Yudong Guo, Luo Jiang, Lin Cai, Juyong Zhang

Caricature is an abstraction of a real person which distorts or exaggerates certain features, but still retains a likeness.

Caricature Translation

3D Face From X: Learning Face Shape from Diverse Sources

1 code implementation16 Aug 2018 Yudong Guo, Lin Cai, Juyong Zhang

Although 3D scanned data contain accurate geometric information of face shapes, the capture system is expensive and such datasets usually contain a small number of subjects.

3D Face Modelling 3D Face Reconstruction +1

Deep Face Feature for Face Alignment

no code implementations9 Aug 2017 Boyi Jiang, Juyong Zhang, Bailin Deng, Yudong Guo, Ligang Liu

The deep face feature (DFF) is trained using correspondence between face images rendered from different views.

Face Alignment Inverse Rendering +1

CNN-based Real-time Dense Face Reconstruction with Inverse-rendered Photo-realistic Face Images

no code implementations3 Aug 2017 Yudong Guo, Juyong Zhang, Jianfei Cai, Boyi Jiang, Jianmin Zheng

With the powerfulness of convolution neural networks (CNN), CNN based face reconstruction has recently shown promising performance in reconstructing detailed face shape from 2D face images.

3D Face Reconstruction Face Model +1

Digital Makeup from Internet Images

no code implementations16 Oct 2016 Asad Khan, Muhammad Ahmad, Yudong Guo, Ligang Liu

Our algorithm is not restricted to one-to-one image color transfer and can make use of more than one target images to transfer the color in different parts in the source image.

Image Matting

Cannot find the paper you are looking for? You can Submit a new open access paper.