Search Results for author:
Found 5 papers, 0 papers with code
Audio-Enhanced Text-to-Video Retrieval using Text-Conditioned Feature Alignment
Nonetheless, the objective of the text-to-video retrieval task is to capture the complementary audio and video information that is pertinent to the text query rather than simply achieving better audio and video alignment.
Ranked #10 on
Video Retrieval
on MSR-VTT
AVT: Audio-Video Transformer for Multimodal Action Recognition
AVT uses a combination of video and audio signals to improve action recognition accuracy, leveraging the effective spatio-temporal representation by the video Transformer.
Ranked #4 on
Multi-modal Classification
on VGG-Sound
Multiscale Multimodal Transformer for Multimodal Action Recognition
In this work, we develop a multiscale multimodal Transformer (MMT) that employs hierarchical representation learning.
Ranked #1 on
Multi-modal Classification
on VGG-Sound
When deep denoising meets iterative phase retrieval
Recovering a signal from its Fourier intensity underlies many important applications, including lensless imaging and imaging through scattering media.
DuDoNet: Dual Domain Network for CT Metal Artifact Reduction
The linkage between the sigogram and image domains is a novel Radon inversion layer that allows the gradients to back-propagate from the image domain to the sinogram domain during training.
