Search Results for author:
Found 159 papers, 101 papers with code
Environment-Aware Dynamic Graph Learning for Out-of-Distribution Generalization
To the best of our knowledge, we are the first to study OOD generalization on dynamic graphs from the environment learning perspective.
Measuring and Improving Attentiveness to Partial Inputs with Counterfactuals
Previous work has found that datasets with paired inputs are prone to correlations between a specific part of the input (e. g., the hypothesis in NLI) and the label; consequently, models trained only on those outperform chance.
Prudent Silence or Foolish Babble? Examining Large Language Models' Responses to the Unknown
When presented with such unanswerable questions, an LLM should appropriately convey uncertainty, and be able to challenge the premise and refuse to generate a response.
MAVEN-Arg: Completing the Puzzle of All-in-One Event Understanding Dataset with Event Argument Annotation
Understanding events in texts is a core objective of natural language understanding, which requires detecting event occurrences, extracting event arguments, and analyzing inter-event relationships.
When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Tasks
In this paper, we find that ICL falls short of handling specification-heavy tasks, which are tasks with complicated and extensive task specifications, requiring several hours for ordinary humans to master, such as traditional information extraction tasks.
RDGCN: Reinforced Dependency Graph Convolutional Network for Aspect-based Sentiment Analysis
Aspect-based sentiment analysis (ABSA) is dedicated to forecasting the sentiment polarity of aspect terms within sentences.
JPAVE: A Generation and Classification-based Model for Joint Product Attribute Prediction and Value Extraction
Furthermore, the copy mechanism in value generator and the value attention module in value classifier help our model address the data discrepancy issue by only focusing on the relevant part of input text and ignoring other information which causes the discrepancy issue such as sentence structure in the text.
MultiSPANS: A Multi-range Spatial-Temporal Transformer Network for Traffic Forecast via Structural Entropy Optimization
Based on this, we propose a relative structural entropy-based position encoding and a multi-head attention masking scheme based on multi-layer encoding trees.
Uncertainty-guided Boundary Learning for Imbalanced Social Event Detection
While in our observation, compared to the rarity of classes, the calibrated uncertainty estimated from well-trained evidential deep learning networks better reflects model performance.
Language Models Hallucinate, but May Excel at Fact Verification
Recent progress in natural language processing (NLP) owes much to remarkable advances in large language models (LLMs).
Knowledge Graph Context-Enhanced Diversified Recommendation
Collectively, our contributions signify a substantial stride towards augmenting the panorama of recommendation diversity within the realm of KG-informed RecSys paradigms.
Unified Pretraining for Recommendation via Task Hypergraphs
On the other hand, pretraining and finetuning on the same dataset leads to a high risk of overfitting.
Multi-omics Sampling-based Graph Transformer for Synthetic Lethality Prediction
We showcase the effectiveness of MSGT-SL on real-world SL tasks, demonstrating the empirical benefits gained from the graph transformer and multi-omics data.
FiLM: Fill-in Language Models for Any-Order Generation
Language models have become the backbone of today's AI systems.
FedFed: Feature Distillation against Data Heterogeneity in Federated Learning
Comprehensive experiments demonstrate the efficacy of FedFed in promoting model performance.
TRAM: Bridging Trust Regions and Sharpness Aware Minimization
We find that TRAM outperforms both sharpness-aware and trust region-based optimization methods on cross-domain language modeling and cross-lingual transfer, where robustness to domain transfer and representation generality are critical for success.
CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets
It creates toolsets specifically curated for the tasks and equips LLMs with a component that retrieves tools from these sets to enhance their capability to solve complex tasks.
OmniEvent: A Comprehensive, Fair, and Easy-to-Use Toolkit for Event Understanding
Event understanding aims at understanding the content and relationship of events within texts, which covers multiple complicated information extraction tasks: event detection, event argument extraction, and event relation extraction.
MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback
However, current evaluation protocols often emphasize benchmark performance with single-turn exchanges, neglecting the nuanced interactions among the user, LLMs, and external tools, while also underestimating the importance of natural language feedback from users.
Unsupervised Skin Lesion Segmentation via Structural Entropy Minimization on Multi-Scale Superpixel Graphs
In this work, we propose a novel unsupervised Skin Lesion sEgmentation framework based on structural entropy and isolation forest outlier Detection, namely SLED.
Group Identification via Transitional Hypergraph Convolution with Cross-view Self-supervised Learning
With the proliferation of social media, a growing number of users search for and join group activities in their daily life.
Efficiency Pentathlon: A Standardized Arena for Efficiency Evaluation
In response, we introduce Pentathlon, a benchmark for holistic and realistic evaluation of model efficiency.
Multi-task Item-attribute Graph Pre-training for Strict Cold-start Item Recommendation
We explore the role of the fine-grained item attributes in bridging the gaps between the existing and the SCS items and pre-train a knowledgeable item-attribute graph for SCS item recommendation.
Addressing the Rank Degeneration in Sequential Recommendation via Singular Spectrum Smoothing
We also establish a correlation between the ranks of sequence and item embeddings and the rank of the user-item preference prediction matrix, which can affect recommendation diversity.
KoLA: Carefully Benchmarking World Knowledge of Large Language Models
The unprecedented performance of large language models (LLMs) necessitates improvements in evaluations.
The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation
In this paper, we check the reliability of EE evaluations and identify three major pitfalls: (1) The data preprocessing discrepancy makes the evaluation results on the same dataset not directly comparable, but the data preprocessing details are not widely noted and specified in papers.
Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performance
As large language models (LLMs) are continuously being developed, their evaluation becomes increasingly important yet challenging.
Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedback
We study whether multiple large language models (LLMs) can autonomously improve each other in a negotiation game by playing, reflecting, and criticizing.
LeTI: Learning to Generate from Textual Interactions
LeTI iteratively fine-tunes the model, using the LM objective, on a concatenation of natural language instructions, LM-generated programs, and textual feedback, which is only provided when the generated program fails to solve the task.
Contrastive Graph Clustering in Curvature Spaces
On the other hand, contrastive learning boosts the deep graph clustering but usually struggles in either graph augmentation or hard sample mining.
Hierarchical State Abstraction Based on Structural Information Principles
State abstraction optimizes decision-making by ignoring irrelevant environmental information in reinforcement learning with rich observations.
Hyperbolic Geometric Graph Representation Learning for Hierarchy-imbalance Node Classification
We find that training labeled nodes with different hierarchical properties have a significant impact on the node classification tasks and confirm it in our experiments.
Graph Collaborative Signals Denoising and Augmentation for Recommendation
Moreover, we show that the inclusion of user-user and item-item correlations can improve recommendations for users with both abundant and insufficient interactions.
Effective and Stable Role-Based Multi-Agent Collaboration by Structural Information Principles
Role-based learning is a promising approach to improving the performance of Multi-Agent Reinforcement Learning (MARL).
SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimization
Graph Neural Networks (GNNs) are de facto solutions to structural data learning.
FedACK: Federated Adversarial Contrastive Knowledge Distillation for Cross-Lingual and Cross-Model Social Bot Detection
In particular, a global generator is used to extract the knowledge of global data distribution and distill it into each client's local model.
Reinforcement Learning Guided Multi-Objective Exam Paper Generation
To reduce the repetitive and complex work of instructors, exam paper generation (EPG) technique has become a salient topic in the intelligent education field, which targets at generating high-quality exam paper automatically according to instructor-specified assessment criteria.
A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT
This study provides a comprehensive review of recent research advancements, challenges, and opportunities for PFMs in text, image, graph, as well as other data modalities.
A Comprehensive Survey on Automatic Knowledge Graph Construction
A knowledge graph is built in three steps: knowledge acquisition, knowledge refinement, and knowledge evolution.
Specializing Smaller Language Models towards Multi-Step Reasoning
by paying the price of decreased generic ability, we can clearly lift up the scaling curve of models smaller than 10B towards a specialized multi-step math reasoning ability.
Unbiased and Efficient Self-Supervised Incremental Contrastive Learning
Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning.
Mutual Wasserstein Discrepancy Minimization for Sequential Recommendation
Wasserstein Discrepancy Measurement builds upon the 2-Wasserstein distance, which is more robust, more efficient in small batch sizes, and able to model the uncertainty of stochastic augmentation processes.
Parallel Multi-Extended State Observers based {ADRC} with Application to High-Speed Precision Motion Stage
In particular, the algorithm for calculating the tracking error caused by single ESO's estimation error is constructed.
State of the Art and Potentialities of Graph-level Learning
Traditional approaches to learning a set of graphs heavily rely on hand-crafted features, such as substructures.
Self-organization Preserved Graph Structure Learning with Principle of Relevant Information
Most Graph Neural Networks follow the message-passing paradigm, assuming the observed structure depicts the ground-truth node relationships.
Self-Supervised Continual Graph Learning in Adaptive Riemannian Spaces
On the one hand, existing methods work with the zero-curvature Euclidean space, and largely ignore the fact that curvature varies over the coming graph sequence.
MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction
It contains 103, 193 event coreference chains, 1, 216, 217 temporal relations, 57, 992 causal relations, and 15, 841 subevent relations, which is larger than existing datasets of all the ERE tasks by at least an order of magnitude.
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models
We believe this is a critical bottleneck for realizing human-like cognition in PLMs.
How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers
Our results motivate research on simpler alternatives to input-dependent attention, as well as on methods for better utilization of this mechanism in the Transformer architecture.
Ranking-based Group Identification via Factorized Attention on Social Tripartite Graph
PA layers efficiently learn the relatedness of non-neighbor nodes to improve the information propagation to users.
Sequential Recommendation with Auxiliary Item Relationships via Multi-Relational Transformer
However, it remains a significant challenge to model auxiliary item relationships in SR. To simultaneously model high-order item-item transitions in sequences and auxiliary item relationships, we propose a Multi-relational Transformer capable of modeling auxiliary item relationships for SR (MT4SR).
DAGAD: Data Augmentation for Graph Anomaly Detection
To bridge the gaps, this paper devises a novel Data Augmentation-based Graph Anomaly Detection (DAGAD) framework for attributed graphs, equipped with three specially designed modules: 1) an information fusion module employing graph neural network encoders to learn representations, 2) a graph data augmentation module that fertilizes the training set with generated samples, and 3) an imbalance-tailored learning module to discriminate the distributions of the minority (anomalous) and majority (normal) classes.
Modeling Context With Linear Attention for Scalable Document-Level Translation
Document-level machine translation leverages inter-sentence dependencies to produce more coherent and consistent translations.
Transparency Helps Reveal When Language Models Learn Meaning
Many current NLP systems are built from language models trained to optimize unsupervised objectives on large amounts of raw text.
Complexity-Based Prompting for Multi-Step Reasoning
In this work, we propose complexity-based prompting, a simple and effective example selection scheme for multi-step reasoning.
Heterogeneous Graph Neural Network for Privacy-Preserving Recommendation
To address this issue, we propose a novel heterogeneous graph neural network privacy-preserving method based on a differential privacy mechanism named HeteDP, which provides a double guarantee on graph features and topology.
Information Extraction and Human-Robot Dialogue towards Real-life Tasks: A Baseline Study with the MobileCS Dataset
Recently, there have merged a class of task-oriented dialogue (TOD) datasets collected through Wizard-of-Oz simulated games.
Cross-Network Social User Embedding with Hybrid Differential Privacy Guarantees
Integrating multiple online social networks (OSNs) has important implications for many downstream social mining tasks, such as user preference modelling, recommendation, and link prediction.
A Self-supervised Riemannian GNN with Time Varying Curvature for Temporal Graph Learning
To bridge this gap, we make the first attempt to study the problem of self-supervised temporal graph representation learning in the general Riemannian space, supporting the time-varying curvature to shift among hyperspherical, Euclidean and hyperbolic spaces.
Position-aware Structure Learning for Graph Topology-imbalance by Relieving Under-reaching and Over-squashing
Topology-imbalance is a graph-specific imbalance problem caused by the uneven topology positions of labeled nodes, which significantly damages the performance of GNNs.
Automating DBSCAN via Deep Reinforcement Learning
DBSCAN is widely used in many scientific and engineering fields because of its simplicity and practicality.
A Challenge on Semi-Supervised and Reinforced Task-Oriented Dialog Systems
A challenge on Semi-Supervised and Reinforced Task-Oriented Dialog Systems, Co-located with EMNLP2022 SereTOD Workshop.
BOND: Benchmarking Unsupervised Outlier Node Detection on Static Attributed Graphs
To bridge this gap, we present--to the best of our knowledge--the first comprehensive benchmark for unsupervised outlier node detection on static attributed graphs called BOND, with the following highlights.
Graph-level Neural Networks: Current Progress and Future Directions
To frame this survey, we propose a systematic taxonomy covering GLNNs upon deep neural networks, graph neural networks, and graph pooling.
Evidential Temporal-aware Graph-based Social Event Detection via Dempster-Shafer Theory
To incorporate temporal information into the message passing scheme, we introduce a novel temporal-aware aggregator which assigns weights to neighbours according to an adaptive time exponential decay formula.
Twist Decoding: Diverse Generators Guide Each Other
Our extensive evaluations on machine translation and scientific paper summarization demonstrate that Twist decoding substantially outperforms each model decoded in isolation over various scenarios, including cases where domain-specific and general-purpose models are both available.
XLTime: A Cross-Lingual Knowledge Transfer Framework for Temporal Expression Extraction
To date, work in this area has mostly focused on English as there is a scarcity of labeled data for other languages.
PyGOD: A Python Library for Graph Outlier Detection
PyGOD is an open-source Python library for detecting outliers on graph data.
Deep reinforcement learning guided graph neural networks for brain network analysis
Modern neuroimaging techniques, such as diffusion tensor imaging (DTI) and functional magnetic resonance imaging (fMRI), enable us to model the human brain as a brain network or connectome.
Curvature Graph Generative Adversarial Networks
In this paper, we proposed a novel Curvature Graph Generative Adversarial Networks method, named \textbf{\modelname}, which is the first GAN-based graph representation method in the Riemannian geometric manifold.
Towards Unsupervised Deep Graph Structure Learning
To solve the unsupervised GSL problem, we propose a novel StrUcture Bootstrapping contrastive LearnIng fraMEwork (SUBLIME for abbreviation) with the aid of self-supervised contrastive learning.
Sequential Recommendation via Stochastic Self-Attention
We further argue that BPR loss has no constraint on positive and sampled negative items, which misleads the optimization.
Multimodal Entity Tagging with Multimodal Knowledge Base
We also develop a dataset for the problem using an existing MKB.
Graph Structure Learning with Variational Information Bottleneck
Graph Neural Networks (GNNs) have shown promising results on a broad spectrum of applications.
A Self-supervised Mixed-curvature Graph Neural Network
Instead of working on one single constant-curvature space, we construct a mixed-curvature space via the Cartesian product of multiple Riemannian component spaces and design hierarchical attention mechanisms for learning and fusing the representations across these component spaces.
POLLA: Enhancing the Local Structure Awareness in Long Sequence Spatial-temporal Modeling
Extensive experiments are conducted on five large-scale datasets, which demonstrate that our method achieves state-of-the-art performance and validates the effectiveness brought by local structure information.
Pre-training Recommender Systems via Reinforced Attentive Multi-relational Graph Neural Network
In this paper, we propose a novel Reinforced Attentive Multi-relational Graph Neural Network (RAM-GNN) to the pre-train user and item embeddings on the user and item graph prior to the recommendation step.
Federated Social Recommendation with Graph Neural Network
However, they all require centralized storage of the social links and item interactions of users, which leads to privacy concerns.
Structure-Preserving Graph Kernel for Brain Network Classification
This paper presents a novel graph-based kernel learning approach for connectome analysis.
Towards Graph Self-Supervised Learning with Contrastive Adjusted Zooming
To overcome the aforementioned problems, we introduce a novel self-supervised graph representation learning algorithm via Graph Contrastive Adjusted Zooming, namely G-Zoom, to learn node representations by leveraging the proposed adjusted zooming scheme.
ACE-HGNN: Adaptive Curvature Exploration Hyperbolic Graph Neural Network
Hyperbolic Graph Neural Networks(HGNNs) extend GNNs to hyperbolic space and thus are more effective to capture the hierarchical structures of graphs in node representation learning.
3D Object Detection Combining Semantic and Geometric Features from Point Clouds
The SGNet proposed in this paper has achieved state-of-the-art results for 3D object detection in the KITTI dataset, especially in the detection of small-size objects such as cyclists.
ABC: Attention with Bounded-memory Control
One way to improve the efficiency is to bound the memory size.
TravelBERT: Pre-training Language Model Incorporating Domain-specific Heterogeneous Knowledge into A Unified Representation
To obtain the aforementioned multi-format text, we construct a corpus in the tourism domain and conduct experiments on 5 tourism NLP datasets.
Event Extraction by Associating Event Types and Argument Roles
It ignores meaningful associations among event types and argument roles, leading to relatively poor performance for less frequent types/roles.
Transferring Knowledge Distillation for Multilingual Social Event Detection
Experiments on both synthetic and real-world datasets show the framework to be highly effective at detection in both multilingual data and in languages where training samples are scarce.
Multiplex Graph Networks for Multimodal Brain Network Analysis
In this paper, we propose MGNet, a simple and effective multiplex graph convolutional network (GCN) model for multimodal brain network analysis.
Tailor: Generating and Perturbing Text with Semantic Controls
We craft a set of operations to modify the control codes, which in turn steer generation towards targeted attributes.
A Survey on Deep Learning Event Extraction: Approaches and Applications
Numerous methods, datasets, and evaluation metrics have been proposed in the literature, raising the need for a comprehensive and updated survey.
Spatiotemporal information conversion machine for time-series prediction
Making predictions in a robust way is a difficult task only based on the observed data of a nonlinear system.
Reinforcement Learning-based Dialogue Guided Event Extraction to Exploit Argument Relations
Our approach leverages knowledge of the already extracted arguments of the same sentence to determine the role of arguments that would be difficult to decide individually.
Noised Consistency Training for Text Summarization
In this paper, we argue that this limitation can be overcome by a semi-supervised approach: consistency training which is to leverage large amounts of unlabeled data to improve the performance of supervised learning over a small corpus.
A Robust and Generalized Framework for Adversarial Graph Embedding
With the prevalence of graph data in real-world applications, many methods have been proposed in recent years to learn high-quality graph embedding vectors various types of graphs.
Differentially Private Federated Knowledge Graphs Embedding
However, for multiple cross-domain knowledge graphs, state-of-the-art embedding models cannot make full use of the data from different knowledge domains while preserving the privacy of exchanged data.
Graph Entropy Guided Node Embedding Dimension Selection for Graph Neural Networks
Based on them, we design MinGE to directly calculate the ideal node embedding dimension for any graph.
Federated Multi-View Learning for Private Medical Data Integration and Analysis
This paper aims to provide a generic Federated Multi-View Learning (FedMV) framework for multi-view data leakage prevention, which is based on different types of local data availability and enables to accommodate two types of problems: Vertical Federated Multi-View Learning (V-FedMV) and Horizontal Federated Multi-View Learning (H-FedMV).
Higher-Order Attribute-Enhancing Heterogeneous Graph Neural Networks
Furthermore, they cannot fully capture the content-based correlations between nodes, as they either do not use the self-attention mechanism or only use it to consider the immediate neighbors of each node, ignoring the higher-order neighbors.
Reinforced Neighborhood Selection Guided Multi-Relational Graph Neural Networks
To avoid the embedding over-assimilation among different types of nodes, we employ a label-aware neural similarity measure to ascertain the most similar neighbors based on node attributes.
Ranked #3 on
Node Classification
on Amazon-Fraud
HTCInfoMax: A Global Model for Hierarchical Text Classification via Information Maximization
The second one encourages the structure encoder to learn better representations with desired characteristics for all labels which can better handle label imbalance in hierarchical text classification.
Hyperbolic Variational Graph Neural Network for Modeling Dynamic Graphs
To model the uncertainty, we devise a hyperbolic graph variational autoencoder built upon the proposed TGNN to generate stochastic node representations of hyperbolic normal distributions.
Streaming Social Event Detection and Evolution Discovery in Heterogeneous Information Networks
Third, we propose a streaming social event detection and evolution discovery framework for HINs based on meta-path similarity search, historical information about meta-paths, and heterogeneous DBSCAN clustering method.
Finetuning Pretrained Transformers into RNNs
Specifically, we propose a swap-then-finetune procedure: in an off-the-shelf pretrained transformer, we replace the softmax attention with its linear-complexity recurrent alternative and then finetune.
Ranked #2 on
Machine Translation
on WMT2017 Chinese-English
KGSynNet: A Novel Entity Synonyms Discovery Framework with Knowledge Graph
Entity synonyms discovery is crucial for entity-leveraging applications.
Random Feature Attention
RFA can be used as a drop-in replacement for conventional softmax attention and offers a straightforward way of learning with recency bias through an optional gating mechanism.
Ranked #27 on
Machine Translation
on IWSLT2014 German-English
FedMood: Federated Learning on Mobile Health Data for Mood Detection
Depression is one of the most common mental illness problems, and the symptoms shown by patients are not consistent, making it difficult to diagnose in the process of clinical practice and pathological research.
Knowledge-Preserving Incremental Social Event Detection via Heterogeneous GNNs
The complexity and streaming nature of social messages make it appealing to address social event detection in an incremental learning setting, where acquiring, preserving, and extending knowledge are major concerns.
SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanism
Graph representation learning has attracted increasing research attention.
Heterogeneous Similarity Graph Neural Network on Electronic Health Records
EHRs contain multiple entities and relations and can be viewed as a heterogeneous graph.
Infusing Finetuning with Semantic Dependencies
For natural language processing systems, two kinds of evidence support the use of text representations from neural language models "pretrained" on large unannotated corpora: performance on application-inspired benchmarks (Peters et al., 2018, inter alia), and the emergence of syntactic abstractions in those representations (Tenney et al., 2019, inter alia).
Hierarchical Bi-Directional Self-Attention Networks for Paper Review Rating Recommendation
Review rating prediction of text reviews is a rapidly growing technology with a wide range of applications in natural language processing.
Learning from Context or Names? An Empirical Study on Neural Relation Extraction
We find that (i) while context is the main source to support the predictions, RE models also heavily rely on the information from entity mentions, most of which is type information, and (ii) existing datasets may leak shallow heuristics via entity mentions and thus contribute to the high performance on RE benchmarks.
Ranked #23 on
Relation Extraction
on TACRED
Kalman Filtering Attention for User Behavior Modeling in CTR Prediction
First, conventional attentions mostly limit the attention field only to a single user's behaviors, which is not suitable in e-commerce where users often hunt for new demands that are irrelevant to any historical behaviors.
KG-BART: Knowledge Graph-Augmented BART for Generative Commonsense Reasoning
To promote the ability of commonsense reasoning for text generation, we propose a novel knowledge graph augmented pre-trained language generation model KG-BART, which encompasses the complex relations of concepts through the knowledge graph and produces more logical and natural sentences as output.
Contextualized Perturbation for Textual Adversarial Attack
Adversarial examples expose the vulnerabilities of natural language processing (NLP) models, and can be used to evaluate and improve their robustness.
Pairwise Learning for Name Disambiguation in Large-Scale Heterogeneous Academic Networks
Although these attributes may change, an author's co-authors and research topics do not change frequently with time, which means that papers within a period have similar text and relation information in the academic network.
Enhancing Graph Neural Network-based Fraud Detectors against Camouflaged Fraudsters
Finally, the selected neighbors across different relations are aggregated together.
Ranked #5 on
Fraud Detection
on Amazon-Fraud
Lifelong Property Price Prediction: A Case Study for the Toronto Real Estate Market
As a departure from prior work, Luce organizes the house data in a heterogeneous information network (HIN) where graph nodes are house entities and attributes that are important for house price valuation.
Adversarial Directed Graph Embedding
To capture the directed edges between nodes, existing methods mostly learn two embedding vectors for each node, source vector and target vector.
A Survey on Text Classification: From Shallow to Deep Learning
The last decade has seen a surge of research in this area due to the unprecedented success of deep learning.
A Mixture of h - 1 Heads is Better than h Heads
Multi-head attentive neural architectures have achieved state-of-the-art results on a variety of natural language processing tasks.
Attentional Graph Convolutional Networks for Knowledge Concept Recommendation in MOOCs in a Heterogeneous View
To address this issue, we leverage both content information and context information to learn the representation of entities via graph convolution network.
Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation
We show that the speed disadvantage for autoregressive baselines compared to non-autoregressive methods has been overestimated in three aspects: suboptimal layer allocation, insufficient speed measurement, and lack of knowledge distillation.
Category-Specific CNN for Visual-aware CTR Prediction at JD.com
Existing algorithms usually extract visual features using off-the-shelf Convolutional Neural Networks (CNNs) and late fuse the visual and non-visual features for the finally predicted CTR.
Heuristic Semi-Supervised Learning for Graph Generation Inspired by Electoral College
Recently, graph-based algorithms have drawn much attention because of their impressive success in semi-supervised setups.
Multi-step-ahead Prediction from Short-term Data by Delay-embedding-based Forecast Machine
Making accurate multi-step-ahead prediction for a complex system is a challenge for many practical applications, especially when only short-term time-series data are available.
A Mixture of $h-1$ Heads is Better than $h$ Heads
Multi-head attentive neural architectures have achieved state-of-the-art results on a variety of natural language processing tasks.
Alleviating the Inconsistency Problem of Applying Graph Neural Network to Fraud Detection
In this paper, we introduce these inconsistencies and design a new GNN framework, $\mathsf{GraphConsis}$, to tackle the inconsistency problem: (1) for the context inconsistency, we propose to combine the context embeddings with node features, (2) for the feature inconsistency, we design a consistency score to filter the inconsistent neighbors and generate corresponding sampling probability, and (3) for the relation inconsistency, we learn a relation attention weights associated with the sampled nodes.
More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction
Relational facts are an important component of human knowledge, which are hidden in vast amounts of text.
Face Beautification: Beyond Makeup Transfer
Inspired by the latest advances in style-based synthesis and face beauty prediction, we propose a novel framework of face beautification.
Digital Twin: Acquiring High-Fidelity 3D Avatar from a Single Image
We present an approach to generate high fidelity 3D face avatar with a high-resolution UV texture map from a single image.
RWNE: A Scalable Random-Walk-Based Network Embedding Framework with Personalized Higher-Order Proximity Preserved
However, despite the success of current random-walk-based methods, most of them are usually not expressive enough to preserve the personalized higher-order proximity and lack a straightforward objective to theoretically articulate what and how network proximity is preserved.
HeteSpaceyWalk: A Heterogeneous Spacey Random Walk for Heterogeneous Information Network Embedding
Heterogeneous information network (HIN) embedding has gained increasing interests recently.
RNN Architecture Learning with Sparse Regularization
Our method also highlights the interpretable properties of rational RNNs.
PaLM: A Hybrid Parser and Language Model
We present PaLM, a hybrid parser and neural language model.
Hierarchical Taxonomy-Aware and Attentional Graph Capsule RCNNs for Large-Scale Multi-Label Text Classification
In this paper, we propose a novel hierarchical taxonomy-aware and attentional graph capsule recurrent CNNs framework for large-scale multi-label text classification.
Dynamic Network Embedding via Incremental Skip-gram with Negative Sampling
Most existing methods focus on learning the structural representations of vertices in a static network, but cannot guarantee an accurate and efficient embedding in a dynamic network scenario.
Fine-grained Event Categorization with Heterogeneous Graph Convolutional Networks
In this paper, we design an event meta-schema to characterize the semantic relatedness of social events and build an event-based heterogeneous information network (HIN) integrating information from external knowledge base, and propose a novel Pair-wise Popularity Graph Convolutional Network (PP-GCN) based fine-grained social event categorization model.
Text Generation with Exemplar-based Adaptive Decoding
We propose a novel conditioned text generation model.
Understanding Beauty via Deep Facial Features
The concept of beauty has been debated by philosophers and psychologists for centuries, but most definitions are subjective and metaphysical, and deficit in accuracy, generality, and scalability.
Graph Convolutional Neural Networks via Motif-based Attention
Different from previous convolutional neural networks on graphs, we first design a motif-matching guided subgraph normalization method to capture neighborhood information.
Modeling relation paths for knowledge base completion via joint adversarial training
By treating relations and multi-hop paths as two different input sources, we use a feature extractor, which is shared by two downstream components (i. e. relation classifier and source discriminator), to capture shared/similar information between them.
Rational Recurrences
We characterize this connection formally, defining rational recurrences to be recurrent hidden state update functions that can be written as the Forward calculation of a finite set of WFSAs.
Show, Attend and Translate: Unsupervised Image Translation with Self-Regularization and Attention
It has been applied to numerous domains, such as data augmentation, domain adaptation, and unsupervised training.
Backpropagating through Structured Argmax using a SPIGOT
We introduce the structured projection of intermediate gradients optimization technique (SPIGOT), a new method for backpropagating through neural networks that include hard-decision structured predictions (e. g., parsing) in intermediate layers.
Learning Joint Semantic Parsers from Disjoint Data
We present a new approach to learning semantic parsers from multiple datasets, even when the target semantic formalisms are drastically different, and the underlying corpora do not overlap.
"You are no Jack Kennedy": On Media Selection of Highlights from Presidential Debates
We first examine the effect of wording and propose a binary classification framework that controls for both the speaker and the debate situation.
Improving Orbit Prediction Accuracy through Supervised Machine Learning
Due to the lack of information such as the space environment condition and resident space objects' (RSOs') body characteristics, current orbit predictions that are solely grounded on physics-based models may fail to achieve required accuracy for collision avoidance and have led to satellite collisions already.
Semi-supervised Structured Prediction with Neural CRF Autoencoder
In this paper we propose an end-to-end neural CRF autoencoder (NCRF-AE) model for semi-supervised learning of sequential structured prediction problems.
Deep Multitask Learning for Semantic Dependency Parsing
We present a deep neural architecture that parses sentences into three semantic dependency graph formalisms.
Asynchronous Distributed Variational Gaussian Processes for Regression
Gaussian processes (GPs) are powerful non-parametric function estimators.
A Convolutional Attention Network for Extreme Summarization of Source Code
Attention mechanisms in neural networks have proved useful for problems in which the input and output do not have fixed dimension.
