Search Results for author:
Found 9 papers, 3 papers with code
Modality-Aware Contrastive Instance Learning with Self-Distillation for Weakly-Supervised Audio-Visual Violence Detection
In this paper, we analyze the modality asynchrony and undifferentiated instances phenomena of the multiple instance learning (MIL) procedure, and further investigate its negative impact on weakly-supervised audio-visual learning.
Anomaly Detection In Surveillance Videos
audio-visual learning
+1
IDEA: Increasing Text Diversity via Online Multi-Label Recognition for Vision-Language Pre-training
However, the image-text pairs co-occurrent on the Internet typically lack explicit alignment information, which is suboptimal for VLP.
Learning Music-Dance Representations through Explicit-Implicit Rhythm Synchronization
Although audio-visual representation has been proved to be applicable in many downstream tasks, the representation of dancing videos, which is more specific and always accompanied by music with complex auditory contents, remains challenging and uninvestigated.
Self-Supervised Video Representation Learning with Motion-Contrastive Perception
Visual-only self-supervised learning has achieved significant improvement in video representation learning.
MM-Pyramid: Multimodal Pyramid Attentional Network for Audio-Visual Event Localization and Video Parsing
Recognizing and localizing events in videos is a fundamental task for video understanding.
Domain Adaptive Cascade R-CNN for MItosis DOmain Generalization (MIDOG) Challenge
We present a summary of the domain adaptive cascade R-CNN method for mitosis detection of digital histopathology images.
MPN: Multimodal Parallel Network for Audio-Visual Event Localization
The localization subnetwork consists of Multimodal Bottleneck Attention Module (MBAM), which is designed to extract fine-grained segment-level contents.
Look, Listen, and Attend: Co-Attention Network for Self-Supervised Audio-Visual Representation Learning
When watching videos, the occurrence of a visual event is often accompanied by an audio event, e. g., the voice of lip motion, the music of playing instruments.
Keep it Consistent: Topic-Aware Storytelling from an Image Stream via Iterative Multi-agent Communication
Visual storytelling aims to generate a narrative paragraph from a sequence of images automatically.
Ranked #9 on
Visual Storytelling
on VIST
