Search Results for author: Yuanxun Lu

Found 9 papers, 3 papers with code

Matrix3D: Large Photogrammetry Model All-in-One

no code implementations11 Feb 2025 Yuanxun Lu, Jingyang Zhang, Tian Fang, Jean-Daniel Nahmias, Yanghai Tsin, Long Quan, Xun Cao, Yao Yao, Shiwei Li

We present Matrix3D, a unified model that performs several photogrammetry subtasks, including pose estimation, depth prediction, and novel view synthesis using just the same model.

Depth Estimation Depth Prediction +3

EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking Head

no code implementations1 Aug 2024 Qianyun He, Xinya Ji, Yicheng Gong, Yuanxun Lu, Zhengyu Diao, Linjia Huang, Yao Yao, Siyu Zhu, Zhan Ma, Songcen Xu, Xiaofei Wu, Zixiao Zhang, Xun Cao, Hao Zhu

We present a novel approach for synthesizing 3D talking heads with controllable emotion, featuring enhanced lip synchronization and rendering quality.

3D geometry Motion Generation

STAG4D: Spatial-Temporal Anchored Generative 4D Gaussians

no code implementations22 Mar 2024 Yifei Zeng, Yanqin Jiang, Siyu Zhu, Yuanxun Lu, Youtian Lin, Hao Zhu, Weiming Hu, Xun Cao, Yao Yao

Recent progress in pre-trained diffusion models and 3D generation have spurred interest in 4D content creation.

3D Generation

Direct2.5: Diverse Text-to-3D Generation via Multi-view 2.5D Diffusion

no code implementations CVPR 2024 Yuanxun Lu, Jingyang Zhang, Shiwei Li, Tian Fang, David McKinnon, Yanghai Tsin, Long Quan, Xun Cao, Yao Yao

The multi-view 2. 5D diffusion directly models the structural distribution of 3D data, while still maintaining the strong generalization ability of the original 2D diffusion model, filling the gap between 2D diffusion-based and direct 3D diffusion-based methods for 3D content generation.

3D Generation 3D geometry +1

JointNet: Extending Text-to-Image Diffusion for Dense Distribution Modeling

no code implementations10 Oct 2023 Jingyang Zhang, Shiwei Li, Yuanxun Lu, Tian Fang, David McKinnon, Yanghai Tsin, Long Quan, Yao Yao

We introduce JointNet, a novel neural network architecture for modeling the joint distribution of images and an additional dense modality (e. g., depth maps).

Depth Estimation Depth Prediction +1

AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation

no code implementations16 Jun 2023 Yifei Zeng, Yuanxun Lu, Xinya Ji, Yao Yao, Hao Zhu, Xun Cao

Unlike previous approaches that can only synthesize avatars based on simple text descriptions, our method enables the creation of personalized avatars from casually captured face or body images, while still supporting text-based model generation and editing.

Text to 3D

High-Fidelity 3D Face Generation from Natural Language Descriptions

1 code implementation CVPR 2023 Menghua Wu, Hao Zhu, Linjia Huang, Yiyu Zhuang, Yuanxun Lu, Xun Cao

Synthesizing high-quality 3D face models from natural language descriptions is very valuable for many applications, including avatar creation, virtual reality, and telepresence.

Descriptive Face Generation +4

Live Speech Portraits: Real-Time Photorealistic Talking-Head Animation

1 code implementation22 Sep 2021 Yuanxun Lu, Jinxiang Chai, Xun Cao

The first stage is a deep neural network that extracts deep audio features along with a manifold projection to project the features to the target person's speech space.

Image-to-Image Translation Talking Face Generation +2

Cannot find the paper you are looking for? You can Submit a new open access paper.