1 code implementation • 17 Jul 2024 • Chang Liu, Qunfen Lin, Zijiao Zeng, Ye Pan
Our approach can generate facial expressions with multiple emotions, and has the ability to generate random yet natural blinks and eye movements, while maintaining accurate lip synchronization.
no code implementations • 21 Jun 2024 • Jiayan Gan, Zhixing Du, Qiang Li, Huaizong Shao, Jingran Lin, Ye Pan, Zhongyi Wen, Shafei Wang
However, DL algorithms face the computational cost problem as the difficulty of the RFF task and the size of the DNN have increased dramatically.
no code implementations • 2 Apr 2024 • Shuai Tan, Bin Ji, Mengxiao Bi, Ye Pan
Achieving disentangled control over multiple facial motions and accommodating diverse input modalities greatly enhances the application and entertainment of the talking head generation.
no code implementations • 2 Apr 2024 • Hanqian Li, Ruinan Zhang, Ye Pan, Junchi Ren, Fei Shen
To address this, we propose a novel location refined feature pyramid network (LR-FPN) to enhance the extraction of shallow positional information and facilitate fine-grained context interaction.
no code implementations • CVPR 2024 • Shuai Tan, Bin Ji, Ye Pan
Specifically, we develop a flow-based coefficient generator that encodes the dynamics of facial emotion into a multi-emotion-class latent space represented as a mixture distribution.
no code implementations • 11 Mar 2024 • Shuai Tan, Bin Ji, Ye Pan
Although automatically animating audio-driven talking heads has recently received growing interest, previous efforts have mainly concentrated on achieving lip synchronization with the audio, neglecting two crucial elements for generating expressive videos: emotion style and art style.
no code implementations • 11 Mar 2024 • Shuai Tan, Bin Ji, Yu Ding, Ye Pan
To adapt to different speaking styles, we steer clear of employing a universal network by exploring an elaborate HyperStyle to produce the style-specific weights offset for the style branch.
no code implementations • 19 Apr 2023 • Zhuo Chen, Xudong Xu, Yichao Yan, Ye Pan, Wenhan Zhu, Wayne Wu, Bo Dai, Xiaokang Yang
While the use of 3D-aware GANs bypasses the requirement of 3D data, we further alleviate the necessity of style images with the CLIP model being the stylization guidance.
2 code implementations • 29 Mar 2023 • Shaoxu Li, Ye Pan
Our approach models a neural radiance field based on neural graphics primitives, which use a hash table-based position encoder for position embedding.
no code implementations • 28 Mar 2023 • Yuhao Cheng, Yichao Yan, Wenhan Zhu, Ye Pan, Bowen Pan, Xiaokang Yang
Head generation with diverse identities is an important task in computer vision and computer graphics, widely used in multimedia applications.
1 code implementation • 21 Mar 2023 • Shaoxu Li, Ye Pan
We use two proxy cages(inner cage and outer cage) to edit a scene.
no code implementations • ICCV 2023 • Shuai Tan, Bin Ji, Ye Pan
During training, the emotion embedding and mouth features are used as keys, and the corresponding expression features are used as values to create key-value pairs stored in the proposed Motion Memory Net.
no code implementations • 20 Jul 2019 • Wei zhang, Shafei Wang, Ye Pan, Qiang Li, Jingran Lin, Xiaoxiao Wu
This paper considers computation offloading in fog-radio access networks (F-RAN), where multiple user equipments (UEs) offload their computation tasks to the F-RAN through a number of fog nodes.