Search Results for author: Joshua D. Reiss

Found 18 papers, 12 papers with code

Differentiable All-pole Filters for Time-varying Audio Systems

7 code implementations11 Apr 2024 Chin-Yun Yu, Christopher Mitcheltree, Alistair Carson, Stefan Bilbao, Joshua D. Reiss, György Fazekas

Infinite impulse response filters are an essential building block of many time-varying audio systems, such as audio effects and synthesisers.

Audio Effects Modeling Audio Synthesis

SyncFusion: Multimodal Onset-synchronized Video-to-Audio Foley Synthesis

no code implementations23 Oct 2023 Marco Comunità, Riccardo F. Gramaccioni, Emilian Postolache, Emanuele Rodolà, Danilo Comminiello, Joshua D. Reiss

Sound design involves creatively selecting, recording, and editing sound effects for various media like cinema, video games, and virtual/augmented reality.

Optimization Techniques for a Physical Model of Human Vocalisation

no code implementations26 Sep 2023 Mateo Cámara, Zhiyuan Xu, Yisu Zong, José Luis Blanco, Joshua D. Reiss

We present a non-supervised approach to optimize and evaluate the synthesis of non-speech audio effects from a speech production model.

Benchmarking

Modulation Extraction for LFO-driven Audio Effects

1 code implementation22 May 2023 Christopher Mitcheltree, Christian J. Steinmetz, Marco Comunità, Joshua D. Reiss

Low frequency oscillator (LFO) driven audio effects such as phaser, flanger, and chorus, modify an input signal using time-varying filters and delays, resulting in characteristic sweeping or widening effects.

Modelling black-box audio effects with time-varying feature modulation

no code implementations1 Nov 2022 Marco Comunità, Christian J. Steinmetz, Huy Phan, Joshua D. Reiss

Deep learning approaches for black-box modelling of audio effects have shown promise, however, the majority of existing work focuses on nonlinear effects with behaviour on relatively short time-scales, such as guitar amplifiers and distortion.

Steerable discovery of neural audio effects

1 code implementation6 Dec 2021 Christian J. Steinmetz, Joshua D. Reiss

Applications of deep learning for audio effects often focus on modeling analog effects or learning to control effects to emulate a trained audio engineer.

Neural Synthesis of Footsteps Sound Effects with Generative Adversarial Networks

no code implementations18 Oct 2021 Marco Comunità, Huy Phan, Joshua D. Reiss

Footsteps are among the most ubiquitous sound effects in multimedia applications.

Direct design of biquad filter cascades with deep learning by sampling random polynomials

1 code implementation7 Oct 2021 Joseph T. Colonel, Christian J. Steinmetz, Marcus Michelen, Joshua D. Reiss

In this work, we address some of these limitations by learning a direct mapping from the target magnitude response to the filter coefficient space with a neural network trained on millions of random filters.

WaveBeat: End-to-end beat and downbeat tracking in the time domain

1 code implementation4 Oct 2021 Christian J. Steinmetz, Joshua D. Reiss

In this work, we propose WaveBeat, an end-to-end approach for joint beat and downbeat tracking operating directly on waveforms.

Data Augmentation

Efficient neural networks for real-time modeling of analog dynamic range compression

1 code implementation11 Feb 2021 Christian J. Steinmetz, Joshua D. Reiss

Deep learning approaches have demonstrated success in modeling analog audio effects.

Guitar Effects Recognition and Parameter Estimation with Convolutional Neural Networks

1 code implementation6 Dec 2020 Marco Comunità, Dan Stowell, Joshua D. Reiss

Despite the popularity of guitar effects, there is very little existing research on classification and parameter estimation of specific plugins or effect units from guitar recordings.

Classification General Classification

Randomized Overdrive Neural Networks

1 code implementation8 Oct 2020 Christian J. Steinmetz, Joshua D. Reiss

By processing audio signals in the time-domain with randomly weighted temporal convolutional networks (TCNs), we uncover a wide range of novel, yet controllable overdrive effects.

Modeling plate and spring reverberation using a DSP-informed deep neural network

1 code implementation22 Oct 2019 Marco A. Martínez Ramírez, Emmanouil Benetos, Joshua D. Reiss

Plate and spring reverberators are electromechanical systems first used and researched as means to substitute real room reverberation.

A general-purpose deep learning approach to model time-varying audio effects

no code implementations15 May 2019 Marco A. Martínez Ramírez, Emmanouil Benetos, Joshua D. Reiss

Audio processors whose parameters are modified periodically over time are often referred as time-varying or modulation based audio effects.

End-to-End Probabilistic Inference for Nonstationary Audio Analysis

1 code implementation31 Jan 2019 William J. Wilkinson, Michael Riis Andersen, Joshua D. Reiss, Dan Stowell, Arno Solin

A typical audio signal processing pipeline includes multiple disjoint analysis stages, including calculation of a time-frequency representation followed by spectrogram-based feature analysis.

Audio Signal Processing regression

Unifying Probabilistic Models for Time-Frequency Analysis

1 code implementation6 Nov 2018 William J. Wilkinson, Michael Riis Andersen, Joshua D. Reiss, Dan Stowell, Arno Solin

In audio signal processing, probabilistic time-frequency models have many benefits over their non-probabilistic counterparts.

Audio Signal Processing Gaussian Processes +1

Modeling of nonlinear audio effects with end-to-end deep neural networks

1 code implementation15 Oct 2018 Marco Martínez, Joshua D. Reiss

In the context of music production, distortion effects are mainly used for aesthetic reasons and are usually applied to electric musical instruments.

A Generative Model for Natural Sounds Based on Latent Force Modelling

no code implementations2 Feb 2018 William J. Wilkinson, Joshua D. Reiss, Dan Stowell

Recent advances in analysis of subband amplitude envelopes of natural sounds have resulted in convincing synthesis, showing subband amplitudes to be a crucial component of perception.

Cannot find the paper you are looking for? You can Submit a new open access paper.