Search Results for author:
Found 6 papers, 1 papers with code
Beyond Mono to Binaural: Generating Binaural Audio from Mono Audio with Depth and Cross Modal Attention
In this work, we argue that depth map of the scene can act as a proxy for inducing distance information of different objects in the scene, for the task of audio binauralization.
Depth Infused Binaural Audio Generation using Hierarchical Cross-Modal Attention
Binaural audio gives the listener the feeling of being in the recording place and enhances the immersive experience if coupled with AR/VR.
Discriminative Semantic Transitive Consistency for Cross-Modal Learning
Cross-modal retrieval is generally performed by projecting and aligning the data from two different modalities onto a shared representation space.
Beyond Image to Depth: Improving Depth Prediction using Echoes
We propose a novel multi modal fusion technique, which incorporates the material properties explicitly while combining audio (echoes) and visual modalities to predict the scene depth.
AVGZSLNet: Audio-Visual Generalized Zero-Shot Learning by Reconstructing Label Features from Multi-Modal Embeddings
We use the semantic relatedness of text embeddings as a means for zero-shot learning by aligning audio and video embeddings with the corresponding class label text feature space.
Ranked #6 on
GZSL Video Classification
on ActivityNet-GZSL(main)
Coordinated Joint Multimodal Embeddings for Generalized Audio-Visual Zeroshot Classification and Retrieval of Videos
We present an audio-visual multimodal approach for the task of zeroshot learning (ZSL) for classification and retrieval of videos.
Ranked #5 on
GZSL Video Classification
on VGGSound-GZSL(main)
