Shared and Private Information Learning in Multimodal Sentiment Analysis with Deep Modal Alignment and Self-supervised Multi-Task Learning

no code implementations • 15 May 2023 • Songning Lai, Jiakang Li, Guinan Guo, Xifeng Hu, Yulong Li, Yuan Tan, Zichen Song, Yutong Liu, Zhaoxia Ren, Chun Wan, Danmin Miao, Zhi Liu

In this work, we propose a deep modal shared information learning module based on the covariance matrix to capture the shared information between modalities.

Multimodal Sentiment Analysis Multi-Task Learning +2