Search Results for author:
Found 11 papers, 2 papers with code
Prior-agnostic Multi-scale Contrastive Text-Audio Pre-training for Parallelized TTS Frontend Modeling
Furthermore, a parallelized TTS frontend model is delicately devised to execute TN, PD, and PBP prediction tasks, respectively in the second stage.
Multi-Modal Automatic Prosody Annotation with Contrastive Pretraining of SSWP
While human prosody annotation contributes a lot to the performance, it is a labor-intensive and time-consuming process, often resulting in inconsistent outcomes.
TranssionADD: A multi-frame reinforcement based sequence tagging model for audio deepfake detection
We propose our novel TranssionADD system as a solution to the challenging problem of model robustness and audio segment outliers in the trace competition.
CPNet: Exploiting CLIP-based Attention Condenser and Probability Map Guidance for High-fidelity Talking Face Generation
Recently, talking face generation has drawn ever-increasing attention from the research community in computer vision due to its arduous challenges and widespread application scenarios, e. g. movie animation and virtual anchor.
Towards Realistic Visual Dubbing with Heterogeneous Sources
The task of few-shot visual dubbing focuses on synchronizing the lip movements with arbitrary speech input for any talking head video.
Towards Using Clothes Style Transfer for Scenario-aware Person Video Generation
To tackle this problem, most recent AdaIN-based architectures are proposed to extract clothes and scenario features for generation.
Towards High-fidelity Singing Voice Conversion with Acoustic Reference and Contrastive Predictive Coding
Experiments show that, compared with the baseline models, our proposed model can significantly improve the naturalness of converted singing voices and the similarity with the target singer.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
PPG-based singing voice conversion with adversarial representation learning
Singing voice conversion (SVC) aims to convert the voice of one singer to that of other singers while keeping the singing content and melody.
Improving Accent Conversion with Reference Encoder and End-To-End Text-To-Speech
Accent conversion (AC) transforms a non-native speaker's accent into a native accent while maintaining the speaker's voice timbre.
ByteSing: A Chinese Singing Voice Synthesis System Using Duration Allocated Encoder-Decoder Acoustic Models and WaveRNN Vocoders
This paper presents ByteSing, a Chinese singing voice synthesis (SVS) system based on duration allocated Tacotron-like acoustic models and WaveRNN neural vocoders.
Generative Adversarial Network based Speaker Adaptation for High Fidelity WaveNet Vocoder
Firstly, due to the noisy input signal of the model, there is still a gap between the quality of generated and natural waveforms.
Generative Adversarial Network
Vocal Bursts Intensity Prediction
