Search Results for author:
Found 8 papers, 3 papers with code
Tackling Data Bias in MUSIC-AVQA: Crafting a Balanced Dataset for Unbiased Question-Answering
In recent years, there has been a growing emphasis on the intersection of audio, vision, and text modalities, driving forward the advancements in multimodal research.
MuseChat: A Conversational Music Recommendation System for Videos
The reasoning module, equipped with the power of Large Language Model (Vicuna-7B) and extended to multi-modal inputs, is able to provide reasonable explanation for the recommended music.
CAVEN: An Embodied Conversational Agent for Efficient Audio-Visual Navigation in Noisy Environments
Audio-visual navigation of an agent towards locating an audio goal is a challenging task especially when the audio is sporadic or the environment is noisy.
KGTrust: Evaluating Trustworthiness of SIoT via Knowledge Enhanced Graph Neural Networks
Graph neural networks for trust evaluation typically adopt a straightforward way such as one-hot or node2vec to comprehend node characteristics, which ignores the valuable semantic knowledge attached to nodes.
How Does it Sound?
It is often the case that the experience of watching the video can be enhanced by adding a musical soundtrack that is in-sync with the rhythmic features of these activities.
Multi-Instrumentalist Net: Unsupervised Generation of Music from Body Movements
We propose a novel system that takes as an input body movements of a musician playing a musical instrument and generates music in an unsupervised setting.
Audeo: Audio Generation for a Silent Performance Video
We present a novel system that gets as an input video frames of a musician playing the piano and generates the music for that video.
PREDICT & CLUSTER: Unsupervised Skeleton Based Action Recognition
Given inputs of body keypoints sequences obtained during various movements, our system associates the sequences with actions.
