Browse SoTA > Computer Vision > Talking Face Generation > Constrained Lip-synchronization

Constrained Lip-synchronization

3 papers with code · Computer Vision

This task deals with lip-syncing a video (or) an image to the desired target speech. Approaches in this task work only for a specific (limited set) of identities, languages, speech/voice. See also: Unconstrained lip-synchronization - https://paperswithcode.com/task/lip-sync

Benchmarks

No evaluation results yet. Help compare methods by submit evaluation metrics.

Greatest papers with code

Real-Time Lip Sync for Live 2D Animation

19 Oct 2019deepalianeja/CharacterLipSync2D

The emergence of commercial tools for real-time performance-based 2D animation has enabled 2D characters to appear on live broadcasts and streaming platforms.

CONSTRAINED LIP-SYNCHRONIZATION DATA AUGMENTATION

ObamaNet: Photo-realistic lip-sync from text

6 Dec 2017ung200/thats-what-obama-said

We present ObamaNet, the first architecture that generates both audio and synchronized photo-realistic lip-sync videos from any new text.

CONSTRAINED LIP-SYNCHRONIZATION

DeepFakes: a New Threat to Face Recognition? Assessment and Detection

20 Dec 2018CatoGit/Comparing-the-Performance-of-Deepfake-Detection-Methods-on-Benchmark-Datasets

The best performing method, which is based on visual quality metrics and is often used in presentation attack detection domain, resulted in 8. 97% equal error rate on high quality Deepfakes.

CONSTRAINED LIP-SYNCHRONIZATION FACE RECOGNITION FACE SWAPPING