Search Results for author: Soujanya Poria

Found 74 papers, 46 papers with code

CMU-MOSEAS: A Multimodal Language Dataset for Spanish, Portuguese, German and French

no code implementations EMNLP 2020 AmirAli Bagher Zadeh, Yansheng Cao, Simon Hessner, Paul Pu Liang, Soujanya Poria, Louis-Philippe Morency

It covers a diverse set topics and speakers, and carries supervision of 20 labels including sentiment (and subjectivity), emotions, and attributes.

Knowledge Enhanced Reflection Generation for Counseling Dialogues

no code implementations ACL 2022 Siqi Shen, Veronica Perez-Rosas, Charles Welch, Soujanya Poria, Rada Mihalcea

We propose a pipeline that collects domain knowledge through web mining, and show that retrieval from both domain-specific and commonsense knowledge bases improves the quality of generated responses.

Causal Augmentation for Causal Sentence Classification

1 code implementation EMNLP (CINLP) 2021 Fiona Anting Tan, Devamanyu Hazarika, See-Kiong Ng, Soujanya Poria, Roger Zimmermann

Scarcity of annotated causal texts leads to poor robustness when training state-of-the-art language models for causal sentence classification.

Classification Sentence Classification

SANCL: Multimodal Review Helpfulness Prediction with Selective Attention and Natural Contrastive Learning

2 code implementations12 Sep 2022 Wei Han, Hui Chen, Zhen Hai, Soujanya Poria, Lidong Bing

With the boom of e-commerce, Multimodal Review Helpfulness Prediction (MRHP), which aims to sort product reviews according to the predicted helpfulness scores has become a research hotspot.

Contrastive Learning

DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification

1 code implementation12 Sep 2022 Hui Chen, Wei Han, Diyi Yang, Soujanya Poria

This paper proposes a simple yet effective interpolation-based data augmentation approach termed DoubleMix, to improve the robustness of models in text classification.

Classification Text Augmentation +2

Analyzing Modality Robustness in Multimodal Sentiment Analysis

1 code implementation NAACL 2022 Devamanyu Hazarika, Yingting Li, Bo Cheng, Shuai Zhao, Roger Zimmermann, Soujanya Poria

In this work, we hope to address that by (i) Proposing simple diagnostic checks for modality robustness in a trained multimodal model.

Multimodal Sentiment Analysis

KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks

2 code implementations6 Oct 2021 Rishabh Bhardwaj, Tushar Vaidya, Soujanya Poria

We propose a new approach, Knowledge Distillation using Optimal Transport (KNOT), to distill the natural language semantic knowledge from multiple teacher networks to a student network.

Emotion Recognition in Conversation Knowledge Distillation +4

PIP: Physical Interaction Prediction via Mental Simulation with Span Selection

no code implementations10 Sep 2021 Jiafei Duan, Samson Yu, Soujanya Poria, Bihan Wen, Cheston Tan

However, there is a lack of intuitive physics models that are tested on long physical interaction sequences with multiple interactions among different objects.

Semantic Object Interaction Classification

Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis

2 code implementations EMNLP 2021 Wei Han, Hui Chen, Soujanya Poria

In this work, we propose a framework named MultiModal InfoMax (MMIM), which hierarchically maximizes the Mutual Information (MI) in unimodal input pairs (inter-modality) and between multimodal fusion result and unimodal input in order to maintain task-related information through multimodal fusion.

Multimodal Sentiment Analysis

Improving Distantly Supervised Relation Extraction with Self-Ensemble Noise Filtering

1 code implementation RANLP 2021 Tapas Nayak, Navonil Majumder, Soujanya Poria

Distantly supervised models are very popular for relation extraction since we can obtain a large amount of training data using the distant supervision method without human annotation.

Relation Extraction

M2H2: A Multimodal Multiparty Hindi Dataset For Humor Recognition in Conversations

1 code implementation3 Aug 2021 Dushyant Singh Chauhan, Gopendra Vikram Singh, Navonil Majumder, Amir Zadeh, Asif Ekbal, Pushpak Bhattacharyya, Louis-Philippe Morency, Soujanya Poria

We propose several strong multimodal baselines and show the importance of contextual and multimodal information for humor recognition in conversations.

Dialogue Understanding

Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

2 code implementations28 Jul 2021 Wei Han, Hui Chen, Alexander Gelbukh, Amir Zadeh, Louis-Philippe Morency, Soujanya Poria

Multimodal sentiment analysis aims to extract and integrate semantic information collected from multiple modalities to recognize the expressed emotions and sentiment in multimodal data.

Multimodal Deep Learning Multimodal Sentiment Analysis

Exemplars-guided Empathetic Response Generation Controlled by the Elements of Human Communication

1 code implementation22 Jun 2021 Navonil Majumder, Deepanway Ghosal, Devamanyu Hazarika, Alexander Gelbukh, Rada Mihalcea, Soujanya Poria

We empirically show that these approaches yield significant improvements in empathetic response quality in terms of both automated and human-evaluated metrics.

Empathetic Response Generation Passage Retrieval +1

Deep Neural Approaches to Relation Triplets Extraction: A Comprehensive Survey

no code implementations31 Mar 2021 Tapas Nayak, Navonil Majumder, Pawan Goyal, Soujanya Poria

Recently, with the advances made in continuous representation of words (word embeddings) and deep neural architectures, many research works are published in the area of relation extraction and it is very difficult to keep track of so many papers.

Relation Extraction Word Embeddings

Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answering

no code implementations4 Jan 2021 Fengbin Zhu, Wenqiang Lei, Chao Wang, Jianming Zheng, Soujanya Poria, Tat-Seng Chua

Open-domain Question Answering (OpenQA) is an important task in Natural Language Processing (NLP), which aims to answer a question in the form of natural language based on large-scale unstructured documents.

Machine Reading Comprehension Open-Domain Question Answering

Recognizing Emotion Cause in Conversations

1 code implementation22 Dec 2020 Soujanya Poria, Navonil Majumder, Devamanyu Hazarika, Deepanway Ghosal, Rishabh Bhardwaj, Samson Yu Bai Jian, Pengfei Hong, Romila Ghosh, Abhinaba Roy, Niyati Chhaya, Alexander Gelbukh, Rada Mihalcea

We address the problem of recognizing emotion cause in conversations, define two novel sub-tasks of this problem, and provide a corresponding dialogue-level dataset, along with strong Transformer-based baselines.

Causal Emotion Entailment Emotion Cause Extraction

Improving Zero Shot Learning Baselines with Commonsense Knowledge

no code implementations11 Dec 2020 Abhinaba Roy, Deepanway Ghosal, Erik Cambria, Navonil Majumder, Rada Mihalcea, Soujanya Poria

Zero shot learning -- the problem of training and testing on a completely disjoint set of classes -- relies greatly on its ability to transfer knowledge from train classes to test classes.

Word Embeddings Zero-Shot Learning

Persuasive Dialogue Understanding: the Baselines and Negative Results

no code implementations19 Nov 2020 Hui Chen, Deepanway Ghosal, Navonil Majumder, Amir Hussain, Soujanya Poria

Persuasion aims at forming one's opinion and action via a series of persuasive messages containing persuader's strategies.

Dialogue Understanding Intent Recognition +4

MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language Sequences

1 code implementation NAACL 2021 Jianing Yang, Yongxin Wang, Ruitao Yi, Yuying Zhu, Azaan Rehman, Amir Zadeh, Soujanya Poria, Louis-Philippe Morency

Human communication is multimodal in nature; it is through multiple modalities such as language, voice, and facial expressions, that opinions and emotions are expressed.

Emotion Recognition Multimodal Sentiment Analysis

Multimodal Research in Vision and Language: A Review of Current and Emerging Trends

no code implementations19 Oct 2020 Shagun Uppal, Sarthak Bhagat, Devamanyu Hazarika, Navonil Majumdar, Soujanya Poria, Roger Zimmermann, Amir Zadeh

Deep Learning and its applications have cascaded impactful research and development with a diverse range of modalities present in the real-world data.

MIME: MIMicking Emotions for Empathetic Response Generation

1 code implementation EMNLP 2020 Navonil Majumder, Pengfei Hong, Shanshan Peng, Jiankun Lu, Deepanway Ghosal, Alexander Gelbukh, Rada Mihalcea, Soujanya Poria

Current approaches to empathetic response generation view the set of emotions expressed in the input text as a flat structure, where all the emotions are treated uniformly.

Empathetic Response Generation Response Generation

Investigating Gender Bias in BERT

no code implementations10 Sep 2020 Rishabh Bhardwaj, Navonil Majumder, Soujanya Poria

As a result, predictions of downstream NLP models can vary noticeably by varying gender words, such as replacing "he" to "she", or even gender-neutral words.

text-classification Text Classification +1

Dialogue Relation Extraction with Document-level Heterogeneous Graph Attention Networks

1 code implementation10 Sep 2020 Hui Chen, Pengfei Hong, Wei Han, Navonil Majumder, Soujanya Poria

This graph is fed to a graph attention network for context propagation among relevant nodes, which effectively captures the dialogue context.

Ranked #5 on Dialog Relation Extraction on DialogRE (F1c (v1) metric)

Dialog Relation Extraction Graph Attention +1

Discriminative Dictionary Design for Action Classification in Still Images and Videos

no code implementations20 May 2020 Abhinaba Roy, Biplab Banerjee, Amir Hussain, Soujanya Poria

Specifically, we pose the selection of potent local descriptors as filtering based feature selection problem which ranks the local features per category based on a novel measure of distinctiveness.

Action Classification Action Recognition +1

Improving Aspect-Level Sentiment Analysis with Aspect Extraction

no code implementations3 May 2020 Navonil Majumder, Rishabh Bhardwaj, Soujanya Poria, Amir Zadeh, Alexander Gelbukh, Amir Hussain, Louis-Philippe Morency

Aspect-based sentiment analysis (ABSA), a popular research area in NLP has two distinct parts -- aspect extraction (AE) and labeling the aspects with sentiment polarity (ALSA).

Aspect Extraction Word Embeddings

KinGDOM: Knowledge-Guided DOMain adaptation for sentiment analysis

1 code implementation ACL 2020 Deepanway Ghosal, Devamanyu Hazarika, Abhinaba Roy, Navonil Majumder, Rada Mihalcea, Soujanya Poria

Cross-domain sentiment analysis has received significant attention in recent years, prompted by the need to combat the domain gap between different applications that make use of sentiment analysis.

Domain Adaptation Sentiment Analysis

Factorized Multimodal Transformer for Multimodal Sequential Learning

1 code implementation22 Nov 2019 Amir Zadeh, Chengfeng Mao, Kelly Shi, Yiwei Zhang, Paul Pu Liang, Soujanya Poria, Louis-Philippe Morency

As machine learning leaps towards better generalization to real world, multimodal sequential learning becomes a fundamental research area.

Conversational Transfer Learning for Emotion Recognition

1 code implementation11 Oct 2019 Devamanyu Hazarika, Soujanya Poria, Roger Zimmermann, Rada Mihalcea

We propose an approach, TL-ERC, where we pre-train a hierarchical dialogue model on multi-turn conversations (source) and then transfer its parameters to a conversational emotion classifier (target).

Emotion Recognition in Conversation Transfer Learning

DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation

2 code implementations IJCNLP 2019 Deepanway Ghosal, Navonil Majumder, Soujanya Poria, Niyati Chhaya, Alexander Gelbukh

Emotion recognition in conversation (ERC) has received much attention, lately, from researchers due to its potential widespread applications in diverse areas, such as health-care, education, and human resources.

Emotion Classification Emotion Recognition in Conversation

Variational Fusion for Multimodal Sentiment Analysis

no code implementations13 Aug 2019 Navonil Majumder, Soujanya Poria, Gangeshwar Krishnamurthy, Niyati Chhaya, Rada Mihalcea, Alexander Gelbukh

Multimodal fusion is considered a key step in multimodal tasks such as sentiment analysis, emotion detection, question answering, and others.

Multimodal Sentiment Analysis Question Answering

Towards Multimodal Sarcasm Detection (An \_Obviously\_ Perfect Paper)

1 code implementation ACL 2019 Santiago Castro, Devamanyu Hazarika, Ver{\'o}nica P{\'e}rez-Rosas, Roger Zimmermann, Rada Mihalcea, Soujanya Poria

As a first step towards enabling the development of multimodal approaches for sarcasm detection, we propose a new sarcasm dataset, Multimodal Sarcasm Detection Dataset (MUStARD), compiled from popular TV shows.

Sarcasm Detection

Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)

1 code implementation5 Jun 2019 Santiago Castro, Devamanyu Hazarika, Verónica Pérez-Rosas, Roger Zimmermann, Rada Mihalcea, Soujanya Poria

As a first step towards enabling the development of multimodal approaches for sarcasm detection, we propose a new sarcasm dataset, Multimodal Sarcasm Detection Dataset (MUStARD), compiled from popular TV shows.

Sarcasm Detection

Phonetic-enriched Text Representation for Chinese Sentiment Analysis with Reinforcement Learning

no code implementations23 Jan 2019 Haiyun Peng, Yukun Ma, Soujanya Poria, Yang Li, Erik Cambria

Furthermore, we also fuse phonetic features with textual and visual features in order to mimic the way humans read and understand Chinese text.

Chinese Sentiment Analysis reinforcement-learning +1

DialogueRNN: An Attentive RNN for Emotion Detection in Conversations

2 code implementations1 Nov 2018 Navonil Majumder, Soujanya Poria, Devamanyu Hazarika, Rada Mihalcea, Alexander Gelbukh, Erik Cambria

Emotion detection in conversations is a necessary step for a number of applications, including opinion mining over chat history, social media threads, debates, argumentation mining, understanding consumer feedback in live conversations, etc.

Emotion Classification Emotion Recognition in Conversation +2

Anaphora and Coreference Resolution: A Review

no code implementations30 May 2018 Rhea Sukthanker, Soujanya Poria, Erik Cambria, Ramkumar Thirunavukarasu

Entity resolution aims at resolving repeated references to an entity in a document and forms a core component of natural language processing (NLP) research.

Coreference Resolution Entity Resolution +3

A Deep Learning Approach for Multimodal Deception Detection

no code implementations1 Mar 2018 Gangeshwar Krishnamurthy, Navonil Majumder, Soujanya Poria, Erik Cambria

Automatic deception detection is an important task that has gained momentum in computational linguistics due to its potential applications.

Deception Detection

Memory Fusion Network for Multi-view Sequential Learning

2 code implementations3 Feb 2018 Amir Zadeh, Paul Pu Liang, Navonil Mazumder, Soujanya Poria, Erik Cambria, Louis-Philippe Morency

In this paper, we present a new neural architecture for multi-view sequential learning called the Memory Fusion Network (MFN) that explicitly accounts for both interactions in a neural architecture and continuously models them through time.

Basic tasks of sentiment analysis

no code implementations18 Oct 2017 Iti Chaturvedi, Soujanya Poria, Erik Cambria

Subjectivity detection is the task of identifying objective and subjective sentences.

Aspect Extraction Sentiment Analysis

Recent Trends in Deep Learning Based Natural Language Processing

3 code implementations9 Aug 2017 Tom Young, Devamanyu Hazarika, Soujanya Poria, Erik Cambria

Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art results in many domains.

Benchmarking Multimodal Sentiment Analysis

no code implementations29 Jul 2017 Erik Cambria, Devamanyu Hazarika, Soujanya Poria, Amir Hussain, R. B. V. Subramaanyam

We propose a framework for multimodal sentiment analysis and emotion recognition using convolutional neural network-based feature extraction from text and visual modalities.

Emotion Recognition Multimodal Sentiment Analysis

Tensor Fusion Network for Multimodal Sentiment Analysis

no code implementations EMNLP 2017 Amir Zadeh, Minghai Chen, Soujanya Poria, Erik Cambria, Louis-Philippe Morency

Multimodal sentiment analysis is an increasingly popular research area, which extends the conventional language-based definition of sentiment analysis to a multimodal setup where other relevant modalities accompany language.

Multimodal Sentiment Analysis

Developing a concept-level knowledge base for sentiment analysis in Singlish

no code implementations14 Jul 2017 Rajiv Bajpai, Soujanya Poria, Danyun Ho, Erik Cambria

In this paper, we present Singlish sentiment lexicon, a concept-level knowledge base for sentiment analysis that associates multiword expressions to a set of emotion labels and a polarity value.

Common Sense Reasoning Graph Mining +1

SenticNet 4: A Semantic Resource for Sentiment Analysis Based on Conceptual Primitives

no code implementations COLING 2016 Erik Cambria, Soujanya Poria, Rajiv Bajpai, Bjoern Schuller

An important difference between traditional AI systems and human intelligence is the human ability to harness commonsense knowledge gleaned from a lifetime of learning and experience to make informed decisions.

Dimensionality Reduction Sentiment Analysis

Cannot find the paper you are looking for? You can Submit a new open access paper.