no code implementations • 16 Mar 2024 • Fan Zhang, Zhaohan Wang, Xin Lyu, Siyuan Zhao, Mengjian Li, Weidong Geng, Naye Ji, Hui Du, Fuxing Gao, Hao Wu, Shunman Li
Finally, we employ the diffusion model to train and infer various gestures.
no code implementations • 11 Aug 2023 • Fan Zhang, Naye Ji, Fuxing Gao, Siyuan Zhao, Zhaohan Wang, Shunman Li
Firstly, considering that speech audio not only contains acoustic and semantic features but also conveys personality traits, emotions, and more subtle information related to accompanying gestures, we pioneer the adaptation of WavLM, a large-scale pre-trained model, to extract low-level and high-level audio information.
1 code implementation • 1 Mar 2023 • Runchuan Zhu, Naye Ji, Youbing Zhao, Fan Zhang
Nowadays, the wide application of virtual digital human promotes the comprehensive prosperity and development of digital culture supported by digital economy.
1 code implementation • 24 Jan 2023 • Fan Zhang, Naye Ji, Fuxing Gao, Yongping Li
Speech-driven gesture synthesis is a field of growing interest in virtual human creation.
no code implementations • 4 Mar 2022 • Naye Ji, Fan Zhang, Haoxiang Zhang, Youbing Zhao, Dingguo Yu
To evaluate the effectiveness of the algorithm, we demonstrate a time con-sumption statistical analysis for each stage of the DCO algorithm execution.