Search Results for author:
Found 5 papers, 3 papers with code
Crowdsourcing and Evaluating Text-Based Audio Retrieval Relevances
Conversely, the results suggest that using only binary relevances defined by captioning-based audio-caption pairs is sufficient for contrastive learning.
Simultaneous or Sequential Training? How Speech Representations Cooperate in a Multi-Task Self-Supervised Learning System
As a result, we find that sequential training with wav2vec 2. 0 first and VGS next provides higher performance on audio-visual retrieval compared to simultaneous optimization of both learning mechanisms.
Can phones, syllables, and words emerge as side-products of cross-situational audiovisual learning? -- A computational investigation
We review the extent that the audiovisual aspect of LLH is supported by the existing computational studies.
Evaluation of Audio-Visual Alignments in Visually Grounded Speech Models
We compare the alignment performance using our proposed evaluation metrics to the semantic retrieval task commonly used to evaluate VGS models.
A computational model of early language acquisition from audiovisual experiences of young infants
Earlier research has suggested that human infants might use statistical dependencies between speech and non-linguistic multimodal input to bootstrap their language learning before they know how to segment words from running speech.
