Browse > Natural Language Processing > Sentiment Analysis > Multimodal Sentiment Analysis

Multimodal Sentiment Analysis

11 papers with code · Natural Language Processing
Subtask of Sentiment Analysis

Multimodal sentiment analysis is the task of performing sentiment analysis with multiple data sources - e.g. a camera feed of someone's face and their recorded speech.

State-of-the-art leaderboards

Greatest papers with code

Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors

23 Nov 2018A2Zadeh/CMU-MultimodalSDK

Humans convey their intentions through the usage of both verbal and nonverbal behaviors during face-to-face communication.

EMOTION RECOGNITION MULTIMODAL SENTIMENT ANALYSIS

Multimodal Speech Emotion Recognition Using Audio and Text

10 Oct 2018david-yoon/multimodal-speech-emotion

Speech emotion recognition is a challenging task, and extensive reliance has been placed on models that use audio features in building well-performing classifiers.

EMOTION CLASSIFICATION MULTIMODAL EMOTION RECOGNITION MULTIMODAL SENTIMENT ANALYSIS SPEECH EMOTION RECOGNITION

Efficient Low-rank Multimodal Fusion with Modality-Specific Factors

ACL 2018 Justin1904/Low-rank-Multimodal-Fusion

Previous research in this field has exploited the expressiveness of tensors for multimodal representation.

EMOTION RECOGNITION MULTIMODAL SENTIMENT ANALYSIS

Multimodal Sentiment Analysis with Word-Level Fusion and Reinforcement Learning

3 Feb 2018pliang279/MFN

In this paper, we propose the Gated Multimodal Embedding LSTM with Temporal Attention (GME-LSTM(A)) model that is composed of 2 modules.

MULTIMODAL SENTIMENT ANALYSIS SUBJECTIVITY ANALYSIS

Multi-attention Recurrent Network for Human Communication Comprehension

3 Feb 2018pliang279/MFN

AI must understand each modality and the interactions between them that shape human communication.

EMOTION RECOGNITION MULTIMODAL SENTIMENT ANALYSIS

Multimodal Sentiment Analysis To Explore the Structure of Emotions

ICLR 2018 anthonyhu/tumblr-emotions

We propose a novel approach to multimodal sentiment analysis using deep neural networks combining visual analysis and natural language processing.

MULTIMODAL SENTIMENT ANALYSIS

Select-Additive Learning: Improving Generalization in Multimodal Sentiment Analysis

16 Sep 2016HaohanWang/SelectAdditiveLearning

In this paper, we propose a Select-Additive Learning (SAL) procedure that improves the generalizability of trained neural networks for multimodal sentiment analysis.

MULTIMODAL SENTIMENT ANALYSIS

Found in Translation: Learning Robust Joint Representations by Cyclic Translations Between Modalities

19 Dec 2018hainow/MCTN

Our method is based on the key insight that translation from a source to a target modality provides a method of learning joint representations using only the source modality as input.

MACHINE TRANSLATION MULTIMODAL SENTIMENT ANALYSIS