Search Results for author:
Found 7 papers, 3 papers with code
Bridging High-Quality Audio and Video via Language for Sound Effects Retrieval from Visual Queries
We show that our system, trained using our automatic data curation pipeline, significantly outperforms baselines trained on in-the-wild data on the task of HQ SFX retrieval for video.
Tempo vs. Pitch: understanding self-supervised tempo estimation
Self-supervision methods learn representations by solving pretext tasks that do not require human-generated labels, alleviating the need for time-consuming annotations.
FlowGrad: Using Motion for Visual Sound Source Localization
Most recent work in visual sound source localization relies on semantic audio-visual representations learned in a self-supervised manner, and by design excludes temporal information present in videos.
A Study on Robustness to Perturbations for Representations of Environmental Sound
To accomplish this, we imitate channel effects by injecting perturbations to the audio signal and measure the shift in the new (perturbed) embeddings with three distance measures, making the evaluation domain-dependent but not task-dependent.
Soundata: A Python library for reproducible use of audio datasets
Soundata is a Python library for loading and working with audio datasets in a standardized way, removing the need for writing custom loaders in every project, and improving reproducibility by providing tools to validate data against a canonical version.
Exploring modality-agnostic representations for music classification
We train music instrument classifiers that can take both images or sounds as input, and perform comparably to sound-only or image-only classifiers.
SONYC-UST-V2: An Urban Sound Tagging Dataset with Spatiotemporal Context
In this article, we describe our data collection procedure and propose evaluation metrics for multilabel classification of urban sound tags.
