Speech Drives Templates: Co-Speech Gesture Synthesis with Learned Templates

1 code implementation • ICCV 2021 • Shenhan Qian, Zhi Tu, YiHao Zhi, Wen Liu, Shenghua Gao

Co-speech gesture generation is to synthesize a gesture sequence that not only looks real but also matches with the input speech audio.

Gesture Generation

Dual-Space NeRF: Learning Animatable Avatars and Scene Lighting in Separate Spaces

1 code implementation • 31 Aug 2022 • YiHao Zhi, Shenhan Qian, Xinhao Yan, Shenghua Gao

Previous methods alleviate the inconsistency of lighting by learning a per-frame embedding, but this operation does not generalize to unseen poses.

LivelySpeaker: Towards Semantic-Aware Co-Speech Gesture Generation

1 code implementation • ICCV 2023 • YiHao Zhi, Xiaodong Cun, Xuelin Chen, Xi Shen, Wen Guo, Shaoli Huang, Shenghua Gao

While previous methods are able to generate speech rhythm-synchronized gestures, the semantic context of the speech is generally lacking in the gesticulations.

Gesture Generation

GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyond

1 code implementation • 28 Mar 2024 • Chongjie Ye, Yinyu Nie, Jiahao Chang, Yuantao Chen, YiHao Zhi, Xiaoguang Han

We present GauStudio, a novel modular framework for modeling 3D Gaussian Splatting (3DGS) to provide standardized, plug-and-play components for users to easily customize and implement a 3DGS pipeline.

Novel View Synthesis Surface Reconstruction