Search Results for author:
Found 11 papers, 4 papers with code
DITTO: Diffusion Inference-Time T-Optimization for Music Generation
We propose Diffusion Inference-Time T-Optimization (DITTO), a general-purpose frame-work for controlling pre-trained text-to-music diffusion models at inference-time via optimizing initial noise latents.
Emotion Embedding Spaces for Matching Music to Stories
Content creators often use music to enhance their stories, as it can be a powerful tool to convey emotion.
Neural Pitch-Shifting and Time-Stretching with Controllable LPCNet
Modifying the pitch and timing of an audio signal are fundamental audio editing operations with applications in speech manipulation, audio-visual synchronization, and singing voice editing and synthesis.
Don't Separate, Learn to Remix: End-to-End Neural Remixing with Joint Optimization
In this work, we learn to remix music directly by re-purposing Conv-TasNet, a well-known source separation model, into two neural remixing architectures.
Differentiable Signal Processing With Black-Box Audio Effects
We present a data-driven approach to automate audio signal processing by incorporating stateful third-party, audio effects as layers within a deep neural network.
Context-Aware Prosody Correction for Text-Based Speech Editing
Text-based speech editors expedite the process of editing speech recordings by permitting editing via intuitive cut, copy, and paste operations on a speech transcript.
Disentangled Multidimensional Metric Learning for Music Similarity
For this task, it is typically necessary to define a similarity metric to compare one recording to another.
Metric Learning vs Classification for Disentangled Music Representation Learning
For this, we (1) outline past work on the relationship between metric learning and classification, (2) extend this relationship to multi-label data by exploring three different learning approaches and their disentangled versions, and (3) evaluate all models on four tasks (training time, similarity retrieval, auto-tagging, and triplet prediction).
Controllable Neural Prosody Synthesis
Speech synthesis has recently seen significant improvements in fidelity, driven by the advent of neural vocoders and neural prosody generators.
A Differentiable Perceptual Audio Metric Learned from Just Noticeable Differences
Assessment of many audio processing tasks relies on subjective evaluation which is time-consuming and expensive.
Scene-Aware Audio Rendering via Deep Acoustic Analysis
We present a new method to capture the acoustic characteristics of real-world rooms using commodity devices, and use the captured characteristics to generate similar sounding sources with virtual models.
Sound Graphics Multimedia Audio and Speech Processing
