no code implementations • 13 Mar 2025 • Yasheng Sun, Zhiliang Xu, Hang Zhou, Jiazhi Guan, Quanwei Yang, Kaisiyuan Wang, Borong Liang, YingYing Li, Haocheng Feng, Jingdong Wang, Ziwei Liu, Koike Hideki
Co-speech gesture video synthesis is a challenging task that requires both probabilistic modeling of human gestures and the synthesis of realistic images that align with the rhythmic nuances of speech.
no code implementations • 14 Oct 2024 • Jiazhi Guan, Quanwei Yang, Kaisiyuan Wang, Hang Zhou, Shengyi He, Zhiliang Xu, Haocheng Feng, Errui Ding, Jingdong Wang, Hongtao Xie, Youjian Zhao, Ziwei Liu
We propose a Motion-Enhanced Textural Alignment module to enhance the bond between driving and target signals.
no code implementations • 6 Aug 2024 • Jiazhi Guan, Zhiliang Xu, Hang Zhou, Kaisiyuan Wang, Shengyi He, Zhanwang Zhang, Borong Liang, Haocheng Feng, Errui Ding, Jingtuo Liu, Jingdong Wang, Youjian Zhao, Ziwei Liu
Lip-syncing videos with given audio is the foundation for various applications including the creation of virtual presenters or performers.
no code implementations • 10 May 2023 • Xudong Xie, Zhen Zhu, Zijie Wu, Zhiliang Xu, Yingying Zhu
To our knowledge, ours is the first scheme for this challenging task, including model, training, and evaluation.
no code implementations • 27 Sep 2022 • Zhiliang Xu, Hang Zhou, Zhibin Hong, Ziwei Liu, Jiaming Liu, Zhizhi Guo, Junyu Han, Jingtuo Liu, Errui Ding, Jingdong Wang
Our core idea is to leverage a style-based generator to empower high-fidelity and robust face swapping, thus the generator's advantage can be adopted for optimizing identity similarity.
1 code implementation • 11 Jan 2022 • Zhiliang Xu, Zhibin Hong, Changxing Ding, Zhen Zhu, Junyu Han, Jingtuo Liu, Errui Ding
In this work, we propose a lightweight Identity-aware Dynamic Network (IDN) for subject-agnostic face swapping by dynamically adjusting the model parameters according to the identity information.
1 code implementation • 2 Jun 2021 • Bo Peng, Hongxing Fan, Wei Wang, Jing Dong, Yuezun Li, Siwei Lyu, Qi Li, Zhenan Sun, Han Chen, Baoying Chen, Yanjie Hu, Shenghai Luo, Junrui Huang, Yutong Yao, Boyuan Liu, Hefei Ling, Guosheng Zhang, Zhiliang Xu, Changtao Miao, Changlei Lu, Shan He, Xiaoyan Wu, Wanyi Zhuang
This competition provides a common platform for benchmarking the adversarial game between current state-of-the-art DeepFake creation and detection methods.
no code implementations • 23 Feb 2021 • Zhiliang Xu, Xiyu Yu, Zhibin Hong, Zhen Zhu, Junyu Han, Jingtuo Liu, Errui Ding, Xiang Bai
By simply employing some existing and easy-obtainable prior information, our method can control, transfer, and edit diverse attributes of faces in the wild.
Ranked #1 on
Face Swapping
on FaceForensics++
(FID metric)
no code implementations • 10 Dec 2020 • Lingyue Shen, Zhiliang Xu, Ping Lin, Huaxiong Huang, Shixin Xu
A thermodynamically consistent phase-field model is introduced for simulating motion and shape transformation of vesicles under flow conditions.
Numerical Analysis Numerical Analysis 76T06 92B05 35Q92
no code implementations • 28 Sep 2020 • Yihao Hu, Tong Zhao, Zhiliang Xu, Lizhen Lin
Inspired by the traditional finite difference and finite elements methods and emerging advancements in machine learning, we propose a sequence-to-sequence learning (Seq2Seq) framework called Neural-PDE, which allows one to automatically learn governing rules of any time-dependent PDE system from existing data by using a bidirectional LSTM encoder, and predict the solutions in next $n$ time steps.
1 code implementation • 8 Sep 2020 • Yihao Hu, Tong Zhao, Shixin Xu, Zhiliang Xu, Lizhen Lin
Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering.
1 code implementation • CVPR 2020 • Zhen Zhu, Zhiliang Xu, Ansheng You, Xiang Bai
Experiments on several challenging datasets demonstrate the superiority of GroupDNet on performing the SMIS task.