Browse > Computer Vision > Multimodal Machine Translation > Face to Face Translation

Face to Face Translation

4 papers with code · Computer Vision

Given a video of a person speaking in a source language, generate a video of the same person speaking in a target language.

Leaderboards

No evaluation results yet. Help compare methods by submit evaluation metrics.

Greatest papers with code

Recycle-GAN: Unsupervised Video Retargeting

ECCV 2018 aayushbansal/Recycle-GAN

We introduce a data-driven approach for unsupervised video retargeting that translates content from one domain to another while preserving the style native to a domain, i. e., if contents of John Oliver's speech were to be transferred to Stephen Colbert, then the generated content/speech should be in Stephen Colbert's style.

FACE TO FACE TRANSLATION VIDEO GENERATION

Towards Automatic Face-to-Face Translation

ACM Multimedia, 2019 2019 Rudrabha/LipGAN

As today's digital communication becomes increasingly visual, we argue that there is a need for systems that can automatically translate a video of a person speaking in language A into a target language B with realistic lip synchronization.

FACE TO FACE TRANSLATION MACHINE TRANSLATION

Towards Automatic Face-to-Face Translation

ACM Multimedia, 2019 2019 Rudrabha/LipGAN

In light of the recent breakthroughs in automatic machine translation systems, we propose a novel approach that we term as "Face-to-Face Translation".

 SOTA for Talking Face Generation on LRW (using extra training data)

FACE TO FACE TRANSLATION MACHINE TRANSLATION TALKING FACE GENERATION

Triple consistency loss for pairing distributions in GAN-based face synthesis

8 Nov 2018ESanchezLozano/GANnotation

To show this is effective, we incorporate the triple consistency loss into the training of a new landmark-guided face to face synthesis, where, contrary to previous works, the generated images can simultaneously undergo a large transformation in both expression and pose.

FACE GENERATION FACE TO FACE TRANSLATION