Search Results for author:
Found 47 papers, 25 papers with code
Noise-injected Consistency Training and Entropy-constrained Pseudo Labeling for Semi-supervised Extractive Summarization
Labeling large amounts of extractive summarization data is often prohibitive expensive due to time, financial, and expertise constraints, which poses great challenges to incorporating summarization system in practical applications.
Pseudo-Label Guided Unsupervised Domain Adaptation of Contextual Embeddings
In unsupervised domain adaptation, we aim to train a model that works well on a target domain when provided with labeled source samples and unlabeled target samples.
SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimization
Graph Neural Networks (GNNs) are de facto solutions to structural data learning.
A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT
This study provides a comprehensive review of recent research advancements, current and future challenges, and opportunities for PFMs in text, image, graph, as well as other data modalities.
Unbiased and Efficient Self-Supervised Incremental Contrastive Learning
Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning.
Self-organization Preserved Graph Structure Learning with Principle of Relevant Information
Most Graph Neural Networks follow the message-passing paradigm, assuming the observed structure depicts the ground-truth node relationships.
HiTSKT: A Hierarchical Transformer Model for Session-Aware Knowledge Tracing
Theoretically, within and across these sessions, students' learning dynamics can be very different.
Type Information Utilized Event Detection via Multi-Channel GNNs in Electrical Power Systems
To address the above issues, we propose a Multi-Channel graph neural network utilizing Type information for Event Detection in power systems, named MC-TED, leveraging a semantic channel and a topological channel to enrich information interaction from short texts.
Position-aware Structure Learning for Graph Topology-imbalance by Relieving Under-reaching and Over-squashing
Topology-imbalance is a graph-specific imbalance problem caused by the uneven topology positions of labeled nodes, which significantly damages the performance of GNNs.
THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption
As more and more pre-trained language models adopt on-cloud deployment, the privacy issues grow quickly, mainly for the exposure of plain-text user data (e. g., search history, medical record, bank account).
Task-Specific Expert Pruning for Sparse Mixture-of-Experts
The sparse Mixture-of-Experts (MoE) model is powerful for large-scale pre-training and has achieved promising results due to its model capacity.
MTTrans: Cross-Domain Object Detection with Mean-Teacher Transformer
To solve this problem, we propose an end-to-end cross-domain detection Transformer based on the mean teacher framework, MTTrans, which can fully exploit unlabeled target domain data in object detection training and transfer knowledge between domains via pseudo labels.
Curvature Graph Generative Adversarial Networks
In this paper, we proposed a novel Curvature Graph Generative Adversarial Networks method, named \textbf{\modelname}, which is the first GAN-based graph representation method in the Riemannian geometric manifold.
Exploring Human Mobility for Multi-Pattern Passenger Prediction: A Graph Learning Framework
To reduce this research gap and learn human mobility knowledge from this fixed travel behaviors, we propose a multi-pattern passenger flow prediction framework, MPGCN, based on Graph Convolutional Network (GCN).
Network resilience in the aging brain
Degeneration and adaptation are two competing sides of the same coin called resilience in the progressive processes of brain aging or diseases.
Bi-CLKT: Bi-Graph Contrastive Learning based Knowledge Tracing
The goal of Knowledge Tracing (KT) is to estimate how well students have mastered a concept based on their historical learning of related exercises.
Temporal Knowledge Graph Completion: A Survey
KGC methods assume a knowledge graph is static, but that may lead to inaccurate prediction results because many facts in the knowledge graphs change over time.
Graph Structure Learning with Variational Information Bottleneck
Graph Neural Networks (GNNs) have shown promising results on a broad spectrum of applications.
POLLA: Enhancing the Local Structure Awareness in Long Sequence Spatial-temporal Modeling
Extensive experiments are conducted on five large-scale datasets, which demonstrate that our method achieves state-of-the-art performance and validates the effectiveness brought by local structure information.
ACE-HGNN: Adaptive Curvature Exploration Hyperbolic Graph Neural Network
Hyperbolic Graph Neural Networks(HGNNs) extend GNNs to hyperbolic space and thus are more effective to capture the hierarchical structures of graphs in node representation learning.
Generating Disentangled Arguments with Prompts: A Simple Event Extraction Framework that Works
Event Extraction bridges the gap between text and event signals.
Sentiment Analysis and Topic Modeling for COVID-19 Vaccine Discussions
The outbreak of the novel Coronavirus Disease 2019 (COVID-19) has lasted for nearly two years and caused unprecedented impacts on people's daily life around the world.
Distributed Optimization of Graph Convolutional Network using Subgraph Variance
We first propose a graph augmentation-based partition (GAD-Partition) that can divide original graph into augmented subgraphs to reduce communication by selecting and storing as few significant nodes of other processors as possible while guaranteeing the accuracy of the training.
Gradient Broadcast Adaptation: Defending against the backdoor attack in pre-trained models
Pre-trained language models (e. g, BERT, GPT-3) have revolutionized the NLP research and fine-tuning becomes the indispensable step of downstream adaptation.
Representation Learning for Short Text Clustering
Effective representation learning is critical for short text clustering due to the sparse, high-dimensional and noise attributes of short text corpus.
Event Extraction by Associating Event Types and Argument Roles
It ignores meaningful associations among event types and argument roles, leading to relatively poor performance for less frequent types/roles.
A Survey on Deep Learning Event Extraction: Approaches and Applications
Numerous methods, datasets, and evaluation metrics have been proposed in the literature, raising the need for a comprehensive and updated survey.
Reinforcement Learning-based Dialogue Guided Event Extraction to Exploit Argument Relations
Our approach leverages knowledge of the already extracted arguments of the same sentence to determine the role of arguments that would be difficult to decide individually.
RoSearch: Search for Robust Student Architectures When Distilling Pre-trained Language Models
In order to overcome these security problems, RoSearch is proposed as a comprehensive framework to search the student models with better adversarial robustness when performing knowledge distillation.
Attend and select: A segment selective transformer for microblog hashtag generation
These tokens or phrases may originate from primary fragmental textual pieces (e. g., segments) in the original text and are separated into different segments.
Automated Timeline Length Selection for Flexible Timeline Summarization
This paper presents a better TLS approach for automatically and dynamically determining the TLS timeline length.
Noised Consistency Training for Text Summarization
In this paper, we argue that this limitation can be overcome by a semi-supervised approach: consistency training which is to leverage large amounts of unlabeled data to improve the performance of supervised learning over a small corpus.
A Robust and Generalized Framework for Adversarial Graph Embedding
With the prevalence of graph data in real-world applications, many methods have been proposed in recent years to learn high-quality graph embedding vectors various types of graphs.
Differentially Private Federated Knowledge Graphs Embedding
However, for multiple cross-domain knowledge graphs, state-of-the-art embedding models cannot make full use of the data from different knowledge domains while preserving the privacy of exchanged data.
Graph Entropy Guided Node Embedding Dimension Selection for Graph Neural Networks
Based on them, we design MinGE to directly calculate the ideal node embedding dimension for any graph.
Higher-Order Attribute-Enhancing Heterogeneous Graph Neural Networks
Furthermore, they cannot fully capture the content-based correlations between nodes, as they either do not use the self-attention mechanism or only use it to consider the immediate neighbors of each node, ignoring the higher-order neighbors.
HTCInfoMax: A Global Model for Hierarchical Text Classification via Information Maximization
The second one encourages the structure encoder to learn better representations with desired characteristics for all labels which can better handle label imbalance in hierarchical text classification.
Streaming Social Event Detection and Evolution Discovery in Heterogeneous Information Networks
Third, we propose a streaming social event detection and evolution discovery framework for HINs based on meta-path similarity search, historical information about meta-paths, and heterogeneous DBSCAN clustering method.
Dynamic Network Embedding Survey
Due to the lack of comprehensive investigation of them, we give a survey of dynamic network embedding in this paper.
Knowledge-Preserving Incremental Social Event Detection via Heterogeneous GNNs
The complexity and streaming nature of social messages make it appealing to address social event detection in an incremental learning setting, where acquiring, preserving, and extending knowledge are major concerns.
SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanism
Graph representation learning has attracted increasing research attention.
Chaotic-to-Fine Clustering for Unlabeled Plant Disease Images
Current annotation for plant disease images depends on manual sorting and handcrafted features by agricultural experts, which is time-consuming and labour-intensive.
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning.
Ranked #5 on
Time Series Forecasting
on ETTh2 (48)
(using extra training data)
Multivariate Time Series Forecasting
Univariate Time Series Forecasting
Hierarchical Bi-Directional Self-Attention Networks for Paper Review Rating Recommendation
Review rating prediction of text reviews is a rapidly growing technology with a wide range of applications in natural language processing.
Adversarial Directed Graph Embedding
To capture the directed edges between nodes, existing methods mostly learn two embedding vectors for each node, source vector and target vector.
RWNE: A Scalable Random-Walk-Based Network Embedding Framework with Personalized Higher-Order Proximity Preserved
However, despite the success of current random-walk-based methods, most of them are usually not expressive enough to preserve the personalized higher-order proximity and lack a straightforward objective to theoretically articulate what and how network proximity is preserved.
A Lightweight Music Texture Transfer System
In this paper, we initiate a novel system for transferring the texture of music, and release it as an open source project.
