Rethinking the constraints of multimodal fusion: case study in Weakly-Supervised Audio-Visual Video Parsing

no code implementations • 30 May 2021 • Jianning Wu, Zhuqing Jiang, Shiping Wen, Aidong Men, Haiying Wang

For multimodal tasks, a good feature extraction network should extract information as much as possible and ensure that the extracted feature embedding and other modal feature embedding have an excellent mutual understanding.

Semantic Similarity Semantic Textual Similarity +2