Shared and Private Information Learning in Multimodal Sentiment Analysis with Deep Modal Alignment and Self-supervised Multi-Task Learning

no code implementations • 15 May 2023 • Songning Lai, Jiakang Li, Guinan Guo, Xifeng Hu, Yulong Li, Yuan Tan, Zichen Song, Yutong Liu, Zhaoxia Ren, Chun Wan, Danmin Miao, Zhi Liu

In this work, we propose a deep modal shared information learning module based on the covariance matrix to capture the shared information between modalities.

Multimodal Sentiment Analysis Multi-Task Learning +2

A Dynamic 3D Spontaneous Micro-expression Database: Establishment and Evaluation

no code implementations • 31 Jul 2021 • Fengping Wang, Jie Li, Siqi Zhang, Chun Qi, Yun Zhang, Danmin Miao

Micro-expressions are spontaneous, unconscious facial movements that show people's true inner emotions and have great potential in related fields of psychological testing.