Music's Multimodal Complexity in AVQA: Why We Need More than General Multimodal LLMs

no code implementations • 27 May 2025 • Wenhao You, Xingjian Diao, Chunhui Zhang, Keyi Kong, Weiyi Wu, Zhongyu Ouyang, Chiyu Ma, Tingxuan Wu, Noah Wei, Zong Ke, Ming Cheng, Soroush Vosoughi, Jiang Gui

While recent Multimodal Large Language Models exhibit impressive capabilities for general multimodal tasks, specialized domains like music necessitate tailored approaches.

Audio-visual Question Answering Question Answering +1

Learning Musical Representations for Music Performance Question Answering

no code implementations • 10 Feb 2025 • Xingjian Diao, Chunhui Zhang, Tingxuan Wu, Ming Cheng, Zhongyu Ouyang, Weiyi Wu, Jiang Gui

Music performances are representative scenarios for audio-visual modeling.

Question Answering