Search Results for author:
Found 7 papers, 6 papers with code
Object-aware Adaptive-Positivity Learning for Audio-Visual Question Answering
These selected pairs are constrained to have larger similarity values than the mismatched pairs.
Audio-visual Question Answering
Audio-Visual Question Answering (AVQA)
+4
Fine-grained Audible Video Description
We explore a new task for audio-visual-language modeling called fine-grained audible video description (FAVD).
Improving Audio-Visual Video Parsing with Pseudo Visual Labels
We perform extensive experiments on the LLP dataset and demonstrate that our method can generate high-quality segment-level pseudo labels with the help of our newly proposed loss and the label denoising strategy.
Audio-Visual Segmentation with Semantics
To deal with these problems, we propose a new baseline method that uses a temporal pixel-wise audio-visual interaction module to inject audio semantics as guidance for the visual segmentation process.
Contrastive Positive Sample Propagation along the Audio-Visual Event Line
Visual and audio signals often coexist in natural environments, forming audio-visual events (AVEs).
Audio-Visual Segmentation
To deal with the AVS problem, we propose a novel method that uses a temporal pixel-wise audio-visual interaction module to inject audio semantics as guidance for the visual segmentation process.
Positive Sample Propagation along the Audio-Visual Event Line
To encourage the network to extract high correlated features for positive samples, a new audio-visual pair similarity loss is proposed.
