Cosh-DiT: Co-Speech Gesture Video Synthesis via Hybrid Audio-Visual Diffusion Transformers

no code implementations • 13 Mar 2025 • Yasheng Sun, Zhiliang Xu, Hang Zhou, Jiazhi Guan, Quanwei Yang, Kaisiyuan Wang, Borong Liang, YingYing Li, Haocheng Feng, Jingdong Wang, Ziwei Liu, Koike Hideki

Co-speech gesture video synthesis is a challenging task that requires both probabilistic modeling of human gestures and the synthesis of realistic images that align with the rhythmic nuances of speech.

ReSyncer: Rewiring Style-based Generator for Unified Audio-Visually Synced Facial Performer

no code implementations • 6 Aug 2024 • Jiazhi Guan, Zhiliang Xu, Hang Zhou, Kaisiyuan Wang, Shengyi He, Zhanwang Zhang, Borong Liang, Haocheng Feng, Errui Ding, Jingtuo Liu, Jingdong Wang, Youjian Zhao, Ziwei Liu

Lip-syncing videos with given audio is the foundation for various applications including the creation of virtual presenters or performers.

Face Swapping

Expressive Talking Head Generation With Granular Audio-Visual Control

no code implementations • CVPR 2022 • Borong Liang, Yan Pan, Zhizhi Guo, Hang Zhou, Zhibin Hong, Xiaoguang Han, Junyu Han, Jingtuo Liu, Errui Ding, Jingdong Wang

Generating expressive talking heads is essential for creating virtual humans.

Talking Head Generation

Look More Than Once: An Accurate Detector for Text of Arbitrary Shapes

no code implementations • CVPR 2019 • Chengquan Zhang, Borong Liang, Zuming Huang, Mengyi En, Junyu Han, Errui Ding, Xinghao Ding

Previous scene text detection methods have progressed substantially over the past years.

Scene Text Detection Text Detection

Lightweight Pyramid Networks for Image Deraining

no code implementations • 16 May 2018 • Xueyang Fu, Borong Liang, Yue Huang, Xinghao Ding, John Paisley

In this paper, we propose a lightweight pyramid of networks (LPNet) for single image deraining.

8k Single Image Deraining