Search Results for author:
Found 24 papers, 13 papers with code
Accelerating High-Fidelity Waveform Generation via Adversarial Flow Matching Optimization
This paper introduces PeriodWave-Turbo, a high-fidelity and high-efficient waveform generation model via adversarial flow matching optimization.
Ranked #1 on
Speech Synthesis
on LibriTTS
PeriodWave: Multi-Period Flow Matching for High-Fidelity Waveform Generation
Additionally, we utilize a multi-period estimator that avoids overlaps to capture different periodic features of waveform signals.
Ranked #4 on
Speech Synthesis
on LibriTTS
EmoSphere-TTS: Emotional Style and Intensity Modeling via Spherical Emotion Vector for Controllable Emotional Text-to-Speech
Despite rapid advances in the field of emotional text-to-speech (TTS), recent studies primarily focus on mimicking the average style of a particular emotion.
TranSentence: Speech-to-speech Translation via Language-agnostic Sentence-level Speech Encoding without Language-parallel Data
With this method, despite training exclusively on the target language's monolingual data, we can generate target language speech in the inference stage using language-agnostic speech embedding from the source language speech.
DurFlex-EVC: Duration-Flexible Emotional Voice Conversion Leveraging Discrete Representations without Text Alignment
Emotional voice conversion (EVC) involves modifying various acoustic characteristics, such as pitch and spectral envelope, to match a desired emotional state while preserving the speaker's identity.
HierSpeech++: Bridging the Gap between Semantic and Acoustic Representation of Speech by Hierarchical Variational Inference for Zero-shot Speech Synthesis
Furthermore, we significantly improve the naturalness and speaker similarity of synthetic speech even in zero-shot speech synthesis scenarios.
Diff-HierVC: Diffusion-based Hierarchical Voice Conversion with Robust Pitch Generation and Masked Prior for Zero-shot Speaker Adaptation
Finally, by using the masked prior in diffusion models, our model can improve the speaker adaptation quality.
DiffProsody: Diffusion-based Latent Prosody Generation for Expressive Speech Synthesis with Prosody Conditional Adversarial Training
Expressive text-to-speech systems have undergone significant advancements owing to prosody modeling, but conventional methods can still be improved.
HierVST: Hierarchical Adaptive Zero-shot Voice Style Transfer
With a hierarchical adaptive structure, the model can adapt to a novel voice style and convert speech progressively.
PauseSpeech: Natural Speech Synthesis via Pre-trained Language Model and Pause-based Prosody Modeling
Furthermore, we introduce a pause-based word encoder to model word-level prosody based on pause sequence.
HiddenSinger: High-Quality Singing Voice Synthesis via Neural Audio Codec and Latent Diffusion Models
To alleviate the challenges posed by model complexity in singing voice synthesis, we propose HiddenSinger, a high-quality singing voice synthesis system using a neural audio codec and latent diffusion models.
DDDM-VC: Decoupled Denoising Diffusion Models with Disentangled Representation and Prior Mixup for Verified Robust Voice Conversion
To address the above problem, this paper presents decoupled denoising diffusion models (DDDMs) with disentangled representations, which can control the style for each attribute in generative models.
VoiceMixer: Adversarial Voice Style Mixup
This insufficiency leads to the converted speech containing source speech style or losing source speech content.
GC-TTS: Few-shot Speaker Adaptation with Geometric Constraints
While numerous attempts have been made to the few-shot speaker adaptation system, there is still a gap in terms of speaker similarity to the target speaker depending on the amount of data.
Reinforce-Aligner: Reinforcement Alignment Search for Robust End-to-End Text-to-Speech
Experimental results also show the superiority of our proposed model compared to other state-of-the-art TTS models with internal and external aligners.
Fre-GAN: Adversarial Frequency-consistent Audio Synthesis
Although recent works on neural vocoder have improved the quality of synthesized audio, there still exists a gap between generated and ground-truth audio in frequency space.
Audio Dequantization for High Fidelity Audio Generation in Flow-based Neural Vocoder
In recent works, a flow-based neural vocoder has shown significant improvement in real-time speech generation task.
GraphX-Convolution for Point Cloud Deformation in 2D-to-3D Conversion
In this paper, we present a novel deep method to reconstruct a point cloud of an object from a single still image.
HATS: A Hierarchical Graph Attention Network for Stock Movement Prediction
Methods that use relational data for stock market prediction have been recently proposed, but they are still in their infancy.
Deep Video Quality Assessor: From Spatio-temporal Visual Sensitivity to A Convolutional Neural Aggregation Network
Incorporating spatio-temporal human visual perception into video quality assessment (VQA) remains a formidable issue.
Propagating LSTM: 3D Pose Estimation based on Joint Interdependency
We present a novel 3D pose estimation method based on joint interdependency (JI) for acquiring 3D joints from the human pose of an RGB image.
Ranked #222 on
3D Human Pose Estimation
on Human3.6M
Video Frame Interpolation by Plug-and-Play Deep Locally Linear Embedding
We propose a generative framework which takes on the video frame interpolation problem.
Ensemble Deep Learning for Skeleton-Based Action Recognition Using Temporal Sliding LSTM Networks
In our network, we utilize an average ensemble among multiple parts as a final feature to capture various temporal dependencies.
Ranked #120 on
Skeleton Based Action Recognition
on NTU RGB+D
Deep Learning of Human Visual Sensitivity in Image Quality Assessment Framework
Since human observers are the ultimate receivers of digital images, image quality metrics should be designed from a human-oriented perspective.
Full reference image quality assessment
Full-Reference Image Quality Assessment
