Search Results for author: Wei Ai

Found 39 papers, 5 papers with code

MergeME: Model Merging Techniques for Homogeneous and Heterogeneous MoEs

no code implementations3 Feb 2025 YuHang Zhou, Giannis Karamanolakis, Victor Soto, Anna Rumshisky, Mayank Kulkarni, Furong Huang, Wei Ai, Jianhua Lu

The recent success of specialized Large Language Models (LLMs) in domains such as mathematical reasoning and coding has led to growing interest in methods for merging these expert LLMs into a unified Mixture-of-Experts (MoE) model, with the goal of enhancing performance in each domain while retaining effectiveness on general tasks.

Mathematical Reasoning

Large Language Models Meet Graph Neural Networks: A Perspective of Graph Mining

no code implementations26 Dec 2024 Yuxin You, Zhen Liu, Xiangchao Wen, Yongtao Zhang, Wei Ai

Future research needs to continue to explore how to efficiently fuse LLMs and GNNs to achieve more powerful graph learning and reasoning capabilities and provide new impetus for the development of graph mining techniques.

Community Detection Graph Learning +3

GroupFace: Imbalanced Age Estimation Based on Multi-hop Attention Graph Convolutional Network and Group-aware Margin Optimization

no code implementations16 Dec 2024 Yiping Zhang, Yuntao Shou, Wei Ai, Tao Meng, Keqin Li

In addition, to further address the class imbalance problem, we design a dynamic group-aware margin strategy based on reinforcement learning to provide appropriate and unbiased margins for different groups.

Age Estimation

SE-GCL: An Event-Based Simple and Effective Graph Contrastive Learning for Text Representation

no code implementations16 Dec 2024 Tao Meng, Wei Ai, Jianbin Li, Ze Wang, Yuntao Shou, Keqin Li

In particular, we introduce the concept of an event skeleton for core representation semantics and simplify the typically complex data augmentation techniques found in existing graph contrastive learning to boost algorithmic efficiency.

Contrastive Learning Data Augmentation +1

Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversation

no code implementations4 Dec 2024 Yuntao Shou, Tao Meng, Wei Ai, Keqin Li

Multimodal emotion recognition in conversation (MERC) refers to identifying and classifying human emotional states by combining data from multiple different modalities (e. g., audio, images, text, video, etc.).

Emotion Recognition in Conversation Multimodal Emotion Recognition

SDR-GNN: Spectral Domain Reconstruction Graph Neural Network for Incomplete Multimodal Learning in Conversational Emotion Recognition

1 code implementation29 Nov 2024 Fangze Fu, Wei Ai, Fan Yang, Yuntao Shou, Tao Meng, Keqin Li

To address these issues, we propose a Spectral Domain Reconstruction Graph Neural Network (SDR-GNN) for incomplete multimodal learning in conversational emotion recognition.

Graph Neural Network Multimodal Emotion Recognition

Contrastive Multi-graph Learning with Neighbor Hierarchical Sifting for Semi-supervised Text Classification

1 code implementation25 Nov 2024 Wei Ai, Jianbin Li, Ze Wang, Yingying Wei, Tao Meng, Yuntao Shou, Keqin Lib

To address these limitations, we propose a novel method of contrastive multi-graph learning with neighbor hierarchical sifting for semi-supervised text classification, namely ConNHS.

Contrastive Learning Graph Attention +4

SEG:Seeds-Enhanced Iterative Refinement Graph Neural Network for Entity Alignment

no code implementations28 Oct 2024 Wei Ai, Yinghui Gao, Jianbin Li, JiaYi Du, Tao Meng, Yuntao Shou, Keqin Li

Entity alignment is crucial for merging knowledge across knowledge graphs, as it matches entities with identical semantics.

Entity Alignment Graph Neural Network +1

MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignment

no code implementations18 Oct 2024 Wei Ai, Wen Deng, Hongyi Chen, JiaYi Du, Tao Meng, Yuntao Shou

Multi-modal entity alignment (MMEA) is essential for enhancing knowledge graphs and improving information retrieval and question-answering systems.

Information Retrieval Knowledge Graphs +4

Graph Contrastive Learning via Cluster-refined Negative Sampling for Semi-supervised Text Classification

no code implementations18 Oct 2024 Wei Ai, Jianbin Li, Ze Wang, JiaYi Du, Tao Meng, Yuntao Shou, Keqin Li

Additionally, we propose a self-correction mechanism to mitigate the loss of true negative samples caused by clustering inconsistency.

Clustering Contrastive Learning +2

CSRec: Rethinking Sequential Recommendation from A Causal Perspective

1 code implementation23 Aug 2024 Xiaoyu Liu, Jiaxin Yuan, YuHang Zhou, Jingling Li, Furong Huang, Wei Ai

The essence of sequential recommender systems (RecSys) lies in understanding how users make decisions.

Sequential Recommendation

Masked Graph Learning with Recurrent Alignment for Multimodal Emotion Recognition in Conversation

no code implementations23 Jul 2024 Tao Meng, FuChen Zhang, Yuntao Shou, HongEn Shao, Wei Ai, Keqin Li

Unlike traditional unimodal emotion recognition, MERC can fuse complementary semantic information between multiple modalities (e. g., text, audio, and vision) to improve emotion recognition.

Emotion Recognition in Conversation Graph Attention +3

A Multi-view Mask Contrastive Learning Graph Convolutional Neural Network for Age Estimation

no code implementations23 Jul 2024 Yiping Zhang, Yuntao Shou, Tao Meng, Wei Ai, Keqin Li

In the feature extraction stage, we introduce a graph structure to construct face images as input and then design a Multi-view Mask Contrastive Learning (MMCL) mechanism to learn complex structural and semantic information about face images.

Age Estimation Contrastive Learning +2

Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation

1 code implementation19 Jun 2024 YuHang Zhou, Jing Zhu, Paiheng Xu, Xiaoyu Liu, Xiyao Wang, Danai Koutra, Wei Ai, Furong Huang

Large language models (LLMs) have significantly advanced various natural language processing tasks, but deploying them remains computationally expensive.

Knowledge Distillation

Teaching-Assistant-in-the-Loop: Improving Knowledge Distillation from Imperfect Teacher Models in Low-Budget Scenarios

no code implementations8 Jun 2024 YuHang Zhou, Wei Ai

The first signal is the student's self-consistency (consistency of student multiple outputs), which is a proxy of the student's confidence.

Knowledge Distillation

Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph Spectrum

no code implementations27 Apr 2024 Tao Meng, FuChen Zhang, Yuntao Shou, Wei Ai, Nan Yin, Keqin Li

Since consistency and complementarity information correspond to low-frequency and high-frequency information, respectively, this paper revisits the problem of multimodal emotion recognition in conversation from the perspective of the graph spectrum.

Contrastive Learning Emotion Recognition in Conversation +2

Using Artificial Intelligence to Unlock Crowdfunding Success for Small Businesses

no code implementations24 Apr 2024 Teng Ye, Jingnan Zheng, Junhui Jin, Jingyi Qiu, Wei Ai, Qiaozhu Mei

While small businesses are increasingly turning to online crowdfunding platforms for essential funding, over 40% of these campaigns may fail to raise any money, especially those from low socio-economic areas.

Language Modeling Language Modelling +1

The Promises and Pitfalls of Using Language Models to Measure Instruction Quality in Education

no code implementations3 Apr 2024 Paiheng Xu, Jing Liu, Nathan Jones, Julie Cohen, Wei Ai

Assessing instruction quality is a fundamental component of any improvement efforts in the education system.

Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey

no code implementations14 Mar 2024 Xiaoyu Liu, Paiheng Xu, Junda Wu, Jiaxin Yuan, Yifan Yang, YuHang Zhou, Fuxiao Liu, Tianrui Guan, Haoliang Wang, Tong Yu, Julian McAuley, Wei Ai, Furong Huang

Causal inference has shown potential in enhancing the predictive accuracy, fairness, robustness, and explainability of Natural Language Processing (NLP) models by capturing causal relationships among variables.

Causal Inference Fairness

From Adoption to Adaption: Tracing the Diffusion of New Emojis on Twitter

no code implementations22 Feb 2024 YuHang Zhou, Xuan Lu, Wei Ai

In the rapidly evolving landscape of social media, the introduction of new emojis in Unicode release versions presents a structured opportunity to explore digital language evolution.

Sentiment Analysis Sentiment Classification

Emojis Decoded: Leveraging ChatGPT for Enhanced Understanding in Social Media Communications

no code implementations22 Jan 2024 YuHang Zhou, Paiheng Xu, Xiyao Wang, Xuan Lu, Ge Gao, Wei Ai

Our objective is to validate the hypothesis that ChatGPT can serve as a viable alternative to human annotators in emoji research and that its ability to explain emoji meanings can enhance clarity and transparency in online communications.

An Effective Index for Truss-based Community Search on Large Directed Graphs

no code implementations19 Jan 2024 Wei Ai, CanHao Xie, Tao Meng, Yinghao Wu, Keqin Li

Community search is a derivative of community detection that enables online and personalized discovery of communities and has found extensive applications in massive real-world networks.

Community Detection Community Search +2

Fast Butterfly-Core Community Search For Large Labeled Graphs

no code implementations19 Jan 2024 JiaYi Du, Yinghao Wu, Wei Ai, Tao Meng, CanHao Xie, Keqin Li

Community Search (CS) aims to identify densely interconnected subgraphs corresponding to query vertices within a graph.

Community Search

A Two-Stage Multimodal Emotion Recognition Model Based on Graph Contrastive Learning

no code implementations3 Jan 2024 Wei Ai, FuChen Zhang, Tao Meng, Yuntao Shou, HongEn Shao, Keqin Li

To address the above issues, we propose a two-stage emotion recognition model based on graph contrastive learning (TS-GCL).

Classification Contrastive Learning +2

Adversarial Representation with Intra-Modal and Inter-Modal Graph Contrastive Learning for Multimodal Emotion Recognition

no code implementations28 Dec 2023 Yuntao Shou, Tao Meng, Wei Ai, Nan Yin, Keqin Li

However, the existing feature fusion methods have usually mapped the features of different modalities into the same feature space for information fusion, which can not eliminate the heterogeneity between different modalities.

Contrastive Learning Graph Representation Learning +1

DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognition

no code implementations17 Dec 2023 Wei Ai, Yuntao Shou, Tao Meng, Nan Yin, Keqin Li

Specifically, we construct a weighted multi-relationship graph to simultaneously capture the dependencies between speakers and event relations in a dialogue.

Contrastive Learning Multimodal Emotion Recognition +1

Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversations

no code implementations11 Dec 2023 Tao Meng, Yuntao Shou, Wei Ai, Nan Yin, Keqin Li

The main task of Multimodal Emotion Recognition in Conversations (MERC) is to identify the emotions in modalities, e. g., text, audio, image and video, which is a significant development direction for realizing machine intelligence.

Data Augmentation Generative Adversarial Network +3

A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learning

no code implementations10 Dec 2023 Yuntao Shou, Tao Meng, Wei Ai, Nan Yin, Keqin Li

Unlike the traditional single-utterance multi-modal emotion recognition or single-modal conversation emotion recognition, MCER is a more challenging problem that needs to deal with more complex emotional interaction relationships.

Emotion Recognition

Graph Information Bottleneck for Remote Sensing Segmentation

no code implementations5 Dec 2023 Yuntao Shou, Wei Ai, Tao Meng, Nan Yin

Furthermore, this paper innovatively introduces information bottleneck theory into graph contrastive learning to maximize task-related information while minimizing task-independent redundant information.

Change Detection Contrastive Learning +3

CILF-CIAE: CLIP-driven Image-Language Fusion for Correcting Inverse Age Estimation

no code implementations4 Dec 2023 Yuntao Shou, Wei Ai, Tao Meng, Nan Yin, Keqin Li

However, existing CLIP-based age estimation methods require high memory usage (quadratic complexity) when globally modeling images, and lack an error feedback mechanism to prompt the model about the quality of age prediction results.

Age Estimation Image-text matching +2

Explore Spurious Correlations at the Concept Level in Language Models for Text Classification

1 code implementation15 Nov 2023 YuHang Zhou, Paiheng Xu, Xiaoyu Liu, Bang An, Wei Ai, Furong Huang

We find that LMs, when encountering spurious correlations between a concept and a label in training or prompts, resort to shortcuts for predictions.

counterfactual In-Context Learning +2

Kid-Whisper: Towards Bridging the Performance Gap in Automatic Speech Recognition for Children VS. Adults

no code implementations12 Sep 2023 Ahmed Adel Attia, Jing Liu, Wei Ai, Dorottya Demszky, Carol Espy-Wilson

Recent advancements in Automatic Speech Recognition (ASR) systems, exemplified by Whisper, have demonstrated the potential of these systems to approach human-level performance given sufficient data.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1

Emoji Promotes Developer Participation and Issue Resolution on GitHub

no code implementations30 Aug 2023 YuHang Zhou, Xuan Lu, Ge Gao, Qiaozhu Mei, Wei Ai

In this paper, we study how emoji usage influences developer participation and issue resolution in virtual workspaces.

Causal Inference

Pitfalls in Link Prediction with Graph Neural Networks: Understanding the Impact of Target-link Inclusion & Better Practices

no code implementations1 Jun 2023 Jing Zhu, YuHang Zhou, Vassilis N. Ioannidis, Shengyi Qian, Wei Ai, Xiang Song, Danai Koutra

While Graph Neural Networks (GNNs) are remarkably successful in a variety of high-impact applications, we demonstrate that, in link prediction, the common practices of including the edges being predicted in the graph at training and/or test have outsized impact on the performance of low-degree nodes.

Link Prediction Node Classification

GFairHint: Improving Individual Fairness for Graph Neural Networks via Fairness Hint

no code implementations25 May 2023 Paiheng Xu, YuHang Zhou, Bang An, Wei Ai, Furong Huang

Given the growing concerns about fairness in machine learning and the impressive performance of Graph Neural Networks (GNNs) on graph data learning, algorithmic fairness in GNNs has attracted significant attention.

Fairness Link Prediction

Team Resilience under Shock: An Empirical Analysis of GitHub Repositories during Early COVID-19 Pandemic

no code implementations29 Jan 2023 Xuan Lu, Wei Ai, Yixin Wang, Qiaozhu Mei

While many organizations have shifted to working remotely during the COVID-19 pandemic, how the remote workforce and the remote teams are influenced by and would respond to this and future shocks remain largely unknown.

counterfactual

Emojis predict dropouts of remote workers: An empirical study of emoji usage on GitHub

no code implementations10 Feb 2021 Xuan Lu, Wei Ai, Zhenpeng Chen, Yanbin Cao, Qiaozhu Mei

This paper studies how emojis, as non-verbal cues in online communications, can be used for such purposes and how the emotional signals in emoji usage can be used to predict future behavior of workers.

Management

Predicting Individual Treatment Effects of Large-scale Team Competitions in a Ride-sharing Economy

no code implementations7 Aug 2020 Teng Ye, Wei Ai, Lingyu Zhang, Ning Luo, Lulu Zhang, Jieping Ye, Qiaozhu Mei

Through interpreting the best-performing models, we discover many novel and actionable insights regarding how to optimize the design and the execution of team competitions on ride-sharing platforms.

Cannot find the paper you are looking for? You can Submit a new open access paper.