Multimodal Sentiment Detection Based on Multi-channel Graph Neural Networks

1 code implementation • ACL 2021 • Xiaocui Yang, Shi Feng, Yifei Zhang, Daling Wang

In this paper, we propose Multi-channel Graph Neural Networks with Sentiment-awareness (MGNNS) for image-text sentiment detection.

Few-shot Multimodal Sentiment Analysis based on Multimodal Probabilistic Fusion Prompts

1 code implementation • 12 Nov 2022 • Xiaocui Yang, Shi Feng, Daling Wang, Pengfei Hong, Soujanya Poria

To tackle this problem, we propose a novel method called Multimodal Probabilistic Fusion Prompts (MultiPoint) that leverages diverse cues from different modalities for multimodal sentiment detection in the few-shot scenario.

Language Modelling Multimodal Sentiment Analysis

Uncertainty Guided Label Denoising for Document-level Distant Relation Extraction

1 code implementation • 18 May 2023 • Qi Sun, Kun Huang, Xiaocui Yang, Pengfei Hong, Kun Zhang, Soujanya Poria

Therefore, how to select effective pseudo labels to denoise DS data is still a challenge in document-level distant relation extraction.

Denoising Document-level Relation Extraction +1

MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension Tasks

1 code implementation • 13 Oct 2023 • Xiaocui Yang, Wenfang Wu, Shi Feng, Ming Wang, Daling Wang, Yang Li, Qi Sun, Yifei Zhang, XiaoMing Fu, Soujanya Poria

Consequently, our work complements research on the performance of MLLMs in multimodal comprehension tasks, achieving a more comprehensive and holistic evaluation of MLLMs.

Multimodal Reasoning

Consistency Guided Knowledge Retrieval and Denoising in LLMs for Zero-shot Document-level Relation Triplet Extraction

1 code implementation • 24 Jan 2024 • Qi Sun, Kun Huang, Xiaocui Yang, Rong Tong, Kun Zhang, Soujanya Poria

In this paper, we propose a Zero-shot Document-level Relation Triplet Extraction (ZeroDocRTE) framework, which generates labeled data by retrieval and denoising knowledge from LLMs, called GenRDK.

Denoising Relation +2