Search Results for author: Zheng-Yan Sheng

Found 2 papers, 0 papers with code

Face-Driven Zero-Shot Voice Conversion with Memory-based Face-Voice Alignment

no code implementations18 Sep 2023 Zheng-Yan Sheng, Yang Ai, Yan-Nian Chen, Zhen-Hua Ling

This paper presents a novel task, zero-shot voice conversion based on face images (zero-shot FaceVC), which aims at converting the voice characteristics of an utterance from any source speaker to a newly coming target speaker, solely relying on a single face image of the target speaker.

Voice Conversion

Zero-shot personalized lip-to-speech synthesis with face image based voice control

no code implementations9 May 2023 Zheng-Yan Sheng, Yang Ai, Zhen-Hua Ling

In this paper, we propose a zero-shot personalized Lip2Speech synthesis method, in which face images control speaker identities.

Lip to Speech Synthesis Representation Learning +1

Cannot find the paper you are looking for? You can Submit a new open access paper.