Face to Face Translation
4 papers with code • 0 benchmarks • 0 datasets
Given a video of a person speaking in a source language, generate a video of the same person speaking in a target language.
Benchmarks
These leaderboards are used to track progress in Face to Face Translation
Most implemented papers
Pixel-Level Alignment of Facial Images for High Accuracy Recognition Using Ensemble of Patches
The geometry alignment is performed pixel-wise, i. e., every pixel of the face is corresponded to a pixel of the reference face.
Recycle-GAN: Unsupervised Video Retargeting
We introduce a data-driven approach for unsupervised video retargeting that translates content from one domain to another while preserving the style native to a domain, i. e., if contents of John Oliver's speech were to be transferred to Stephen Colbert, then the generated content/speech should be in Stephen Colbert's style.
Triple consistency loss for pairing distributions in GAN-based face synthesis
To show this is effective, we incorporate the triple consistency loss into the training of a new landmark-guided face to face synthesis, where, contrary to previous works, the generated images can simultaneously undergo a large transformation in both expression and pose.
Towards Automatic Face-to-Face Translation
As today's digital communication becomes increasingly visual, we argue that there is a need for systems that can automatically translate a video of a person speaking in language A into a target language B with realistic lip synchronization.