HEAR: Holistic Evaluation of Audio Representations

3 code implementations • 6 Mar 2022 • Joseph Turian, Jordie Shier, Humair Raj Khan, Bhiksha Raj, Björn W. Schuller, Christian J. Steinmetz, Colin Malloy, George Tzanetakis, Gissel Velarde, Kirk McNally, Max Henry, Nicolas Pinto, Camille Noufi, Christian Clough, Dorien Herremans, Eduardo Fonseca, Jesse Engel, Justin Salamon, Philippe Esling, Pranay Manocha, Shinji Watanabe, Zeyu Jin, Yonatan Bisk

The aim of the HEAR benchmark is to develop a general-purpose audio representation that provides a strong basis for learning in a wide variety of tasks and scenarios.

Open-Ended Question Answering

One Billion Audio Sounds from GPU-enabled Modular Synthesis

1 code implementation • 27 Apr 2021 • Joseph Turian, Jordie Shier, George Tzanetakis, Kirk McNally, Max Henry

We release synth1B1, a multi-modal audio corpus consisting of 1 billion 4-second synthesized sounds, paired with the synthesis parameters used to generate them.

Hyperparameter Optimization

I'm Sorry for Your Loss: Spectrally-Based Audio Distances Are Bad at Pitch

no code implementations • 8 Dec 2020 • Joseph Turian, Max Henry

Growing research demonstrates that synthetic failure modes imply poor generalization.

I’m Sorry for Your Loss: Spectrally-Based Audio Distances Are Bad at Pitch

no code implementations • NeurIPS Workshop ICBINB 2020 • Joseph Turian, Max Henry

Growing research demonstrates that synthetic failure modes imply poor generalization.