Search Results for author:
Found 23 papers, 7 papers with code
Enhancing Self-Attention with Knowledge-Assisted Attention Maps
Large-scale pre-trained language models have attracted extensive attentions in the research community and shown promising results on various tasks of natural language processing.
Parameter-efficient is not sufficient: Exploring Parameter, Memory, and Time Efficient Adapter Tuning for Dense Predictions
Despite their success, the existing PETL methods in CV can be computationally expensive and require large amounts of memory and time cost during training, which limits low-resource users from conducting research and applications on large models.
Time-aware Graph Structure Learning via Sequence Prediction on Temporal Graphs
To address these issues, we propose a Time-aware Graph Structure Learning (TGSL) approach via sequence prediction on temporal graphs, which learns better graph structures for downstream tasks through adding potential temporal edges.
AdapterGNN: Efficient Delta Tuning Improves Generalization Ability in Graph Neural Networks
We have also provided a theoretical justification for delta tuning can improve the generalization ability of GNNs by applying generalization bounds.
Generative Adversarial Networks Based on Transformer Encoder and Convolution Block for Hyperspectral Image Classification
Nowadays, HSI classification can reach a high classification accuracy when given sufficient labeled samples as training set.
An Automated Question-Answering Framework Based on Evolution Algorithm
Our framework is based on an innovative evolution algorithm, which is stable and suitable for multiple dataset scenario.
Learning Multi-granularity User Intent Unit for Session-based Recommendation
Specifically, we creatively propose Multi-granularity Intent Heterogeneous Session Graph which captures the interactions between different granularity intent units and relieves the burden of long-dependency.
Creating Training Sets via Weak Indirect Supervision
Creating labeled training sets has become one of the major roadblocks in machine learning.
Graph Pointer Neural Networks
On the one hand, multi-hop-based approaches do not explicitly distinguish relevant nodes from a large number of multi-hop neighborhoods, leading to a severe over-smoothing problem.
Attentive Knowledge-aware Graph Convolutional Networks with Collaborative Guidance for Personalized Recommendation
However, simply integrating KGs in current KG-based RS models is not necessarily a guarantee to improve the recommendation performance, which may even weaken the holistic model capability.
Click-Through Rate Prediction
Knowledge-Aware Recommendation
+1
Adaptive Transfer Learning on Graph Neural Networks
We design an adaptive auxiliary loss weighting model to learn the weights of auxiliary tasks by quantifying the consistency between auxiliary tasks and the target task.
Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting
In this paper, we propose Spectral Temporal Graph Neural Network (StemGNN) to further improve the accuracy of multivariate time-series forecasting.
Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees
Pre-trained language models like BERT achieve superior performances in various NLP tasks without explicit consideration of syntactic information.
Evolving Attention with Residual Convolutions
In this paper, we propose a novel and generic mechanism based on evolving attention to improve the performance of transformers.
Predictive Attention Transformer: Improving Transformer with Attention Map Prediction
Instead, we model their dependencies via a chain of prediction models that take previous attention maps as input to predict the attention maps of a new layer through convolutional neural networks.
AutoADR: Automatic Model Design for Ad Relevance
We add the model designed by AutoADR as a sub-model into the production Ad Relevance model.
Multivariate Time-series Anomaly Detection via Graph Attention Network
Anomaly detection on multivariate time-series is of great importance in both data mining research and industrial applications.
LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compression
BERT is a cutting-edge language representation model pre-trained by a large corpus, which achieves superior performances on various natural language understanding tasks.
TextNAS: A Neural Architecture Search Space tailored for Text Representation
Learning text representation is crucial for text classification and other language related tasks.
Customized Graph Embedding: Tailoring Embedding Vectors to different Applications
For these applications, graph embedding is crucial as it provides vector representations of the graph.
Contractive De-noising Auto-encoder
Auto-encoder is a special kind of neural network based on reconstruction.
