MSR-NV: Neural Vocoder Using Multiple Sampling Rates

no code implementations • 28 Sep 2021 • Kentaro Mitsui, Kei Sawada

In this study, we propose a method to handle multiple sampling rates in a single NV, called the MSR-NV.

Hierarchical Multi-Grained Generative Model for Expressive Speech Synthesis

no code implementations • 17 Sep 2020 • Yukiya Hono, Kazuna Tsuboi, Kei Sawada, Kei Hashimoto, Keiichiro Oura, Yoshihiko Nankaku, Keiichi Tokuda

This framework consists of a multi-grained variational autoencoder, a conditional prior, and a multi-level auto-regressive latent converter to obtain the different time-resolution latent variables and sample the finer-level latent variables from the coarser-level ones by taking into account the input text.

Expressive Speech Synthesis Text-To-Speech Synthesis

Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learning

1 code implementation • ICLR 2021 • Ruozi Huang, Huang Hu, Wei Wu, Kei Sawada, Mi Zhang, Daxin Jiang

In this paper, we formalize the music-conditioned dance generation as a sequence-to-sequence learning problem and devise a novel seq2seq architecture to efficiently process long sequences of music features and capture the fine-grained correspondence between music and dance.

motion synthesis