Search Results for author: Naye Ji

Found 5 papers, 2 papers with code

Audio is all in one: speech-driven gesture synthetics using WavLM pre-trained model

no code implementations11 Aug 2023 Fan Zhang, Naye Ji, Fuxing Gao, Siyuan Zhao, Zhaohan Wang, Shunman Li

Firstly, considering that speech audio not only contains acoustic and semantic features but also conveys personality traits, emotions, and more subtle information related to accompanying gestures, we pioneer the adaptation of WavLM, a large-scale pre-trained model, to extract low-level and high-level audio information.

Gesture Generation

Few-shots Portrait Generation with Style Enhancement and Identity Preservation

1 code implementation1 Mar 2023 Runchuan Zhu, Naye Ji, Youbing Zhao, Fan Zhang

Nowadays, the wide application of virtual digital human promotes the comprehensive prosperity and development of digital culture supported by digital economy.

Cultural Vocal Bursts Intensity Prediction

DiffMotion: Speech-Driven Gesture Synthesis Using Denoising Diffusion Model

1 code implementation24 Jan 2023 Fan Zhang, Naye Ji, Fuxing Gao, Yongping Li

Speech-driven gesture synthesis is a field of growing interest in virtual human creation.

Denoising

Mixed Reality Depth Contour Occlusion Using Binocular Similarity Matching and Three-dimensional Contour Optimisation

no code implementations4 Mar 2022 Naye Ji, Fan Zhang, Haoxiang Zhang, Youbing Zhao, Dingguo Yu

To evaluate the effectiveness of the algorithm, we demonstrate a time con-sumption statistical analysis for each stage of the DCO algorithm execution.

Mixed Reality Optical Flow Estimation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.