Search Results for author:
Found 15 papers, 5 papers with code
PAM: Prompting Audio-Language Models for Audio Quality Assessment
Here, we exploit this capability and introduce PAM, a no-reference metric for assessing audio quality for different audio processing tasks.
Prompting Audios Using Acoustic Properties For Emotion Representation
In this work, we address the challenge of automatically generating these prompts and training a model to better learn emotion representations from audio and prompt pairs.
Training Audio Captioning Models without Audio
During inference, the text encoder is replaced with the pretrained CLAP audio encoder.
Pengi: An Audio Language Model for Audio Tasks
We introduce Pengi, a novel Audio Language Model that leverages Transfer Learning by framing all audio tasks as text-generation tasks.
Synergy between human and machine approaches to sound/scene recognition and processing: An overview of ICASSP special session
Machine Listening, as usually formalized, attempts to perform a task that is, from our perspective, fundamentally human-performable, and performed by humans.
Describing emotions with acoustic property prompts for speech emotion recognition
We investigate how the model can learn to associate the audio with the descriptions, resulting in performance improvement of Speech Emotion Recognition and Speech Audio Retrieval.
Audio Retrieval with WavText5K and CLAP Training
In this work, we propose a new collection of web audio-text pairs and a new framework for retrieval.
Multi-label Sound Event Retrieval Using a Deep Learning-based Siamese Structure with a Pairwise Presence Matrix
State of the art sound event retrieval models have focused on single-label audio recordings, with only one sound event occurring, rather than on multi-label audio recordings (i. e., multiple sound events occur in one recording).
NELS-Never-Ending Learner of Sounds
Sounds are essential to how humans perceive and interact with the world.
Framework for evaluation of sound event detection in web videos
The framework crawls videos using search queries corresponding to 78 sound event labels drawn from three datasets.
An Approach for Self-Training Audio Event Detectors Using Web Data
The audio event detectors are trained on the labeled audio and ran on the unlabeled audio downloaded from YouTube.
AudioPairBank: Towards A Large-Scale Tag-Pair-Based Audio Content Analysis
One contribution is the previously unavailable documentation of the challenges and implications of collecting audio recordings with these type of labels.
City-Identification of Flickr Videos Using Semantic Acoustic Features
In particular, we present a method to compute and use semantic acoustic features to perform city-identification and the features show semantic evidence of the identification.
The YLI-MED Corpus: Characteristics, Procedures, and Plans
The YLI Multimedia Event Detection corpus is a public-domain index of videos with annotations and computed features, specialized for research in multimedia event detection (MED), i. e., automatically identifying what's happening in a video by analyzing the audio and visual content.
YFCC100M: The New Data in Multimedia Research
We present the Yahoo Flickr Creative Commons 100 Million Dataset (YFCC100M), the largest public multimedia collection that has ever been released.
Multimedia Computers and Society H.3.7
