Search Results for author:
Found 8 papers, 5 papers with code
Efficient Generative Modeling with Residual Vector Quantization-Based Tokens
Moreover, we demonstrate that our proposed token masking and multi-token prediction method can be formulated within a principled probabilistic framework using a discrete diffusion process and variational inference.
DiTTo-TTS: Diffusion Transformers for Scalable Text-to-Speech without Domain-Specific Factors
Large-scale latent diffusion models (LDMs) excel in content generation across various modalities, but their reliance on phonemes and durations in text-to-speech (TTS) limits scalability and access from other fields.
CLaM-TTS: Improving Neural Codec Language Model for Zero-Shot Text-to-Speech
With the emergence of neural audio codecs, which encode multiple streams of discrete tokens from audio, large language models have recently gained attention as a promising approach for zero-shot Text-to-Speech (TTS) synthesis.
Mini-Batch Optimization of Contrastive Loss
Contrastive learning has gained significant attention as a method for self-supervised learning.
Censored Sampling of Diffusion Models Using 3 Minutes of Human Feedback
Sometimes, however, a pre-trained diffusion model exhibits partial misalignment in the sense that the model can generate good images, but it sometimes outputs undesirable images.
RedPen: Region- and Reason-Annotated Dataset of Unnatural Speech
We present a novel speech dataset, RedPen, with human annotations on unnatural speech regions and their corresponding reasons.
DailyTalk: Spoken Dialogue Dataset for Conversational Text-to-Speech
The majority of current Text-to-Speech (TTS) datasets, which are collections of individual utterances, contain few conversational aspects.
STYLER: Style Factor Modeling with Rapidity and Robustness via Speech Decomposition for Expressive and Controllable Neural Text to Speech
Previous works on neural text-to-speech (TTS) have been addressed on limited speed in training and inference time, robustness for difficult synthesis conditions, expressiveness, and controllability.
