ACM Multimedia, 2019 2019

Towards Automatic Face-to-Face Translation

ACM Multimedia, 2019 2019 Rudrabha/LipGAN

In light of the recent breakthroughs in automatic machine translation systems, we propose a novel approach that we term as "Face-to-Face Translation".

 SOTA for Talking Face Generation on LRW (using extra training data)

FACE TO FACE TRANSLATION MACHINE TRANSLATION TALKING FACE GENERATION

Towards Automatic Face-to-Face Translation

ACM Multimedia, 2019 2019 Rudrabha/LipGAN

As today's digital communication becomes increasingly visual, we argue that there is a need for systems that can automatically translate a video of a person speaking in language A into a target language B with realistic lip synchronization.

FACE TO FACE TRANSLATION MACHINE TRANSLATION