Search Results for author:
Found 5 papers, 4 papers with code
GestSync: Determining who is speaking without a talking head
In this paper we introduce a new synchronisation task, Gesture-Sync: determining if a person's gestures are correlated with their speech or not.
Lip-to-Speech Synthesis for Arbitrary Speakers in the Wild
With the help of multiple powerful discriminators that guide the training process, our generator learns to synthesize speech sequences in any voice for the lip movements of any person.
Extreme-scale Talking-Face Video Upsampling with Audio-Visual Priors
We show that when we process this $8\times8$ video with the right set of audio and image priors, we can obtain a full-length, $256\times256$ video.
Towards Automatic Speech to Sign Language Generation
Since the current datasets are inadequate for generating sign language directly from speech, we collect and release the first Indian sign language dataset comprising speech-level annotations, text transcripts, and the corresponding sign-language videos.
Visual Speech Enhancement Without A Real Visual Stream
In this work, we re-think the task of speech enhancement in unconstrained real-world environments.
Ranked #1 on
Speech Denoising
on LRS3+VGGSound
