Search Results for author:
Found 15 papers, 8 papers with code
CrossFormer: Cross-Segment Semantic Fusion for Document Segmentation
Text semantic segmentation involves partitioning a document into multiple paragraphs with continuous semantics based on the subject matter, contextual information, and document structure.
Towards Stable, Globally Expressive Graph Representations with Laplacian Eigenvectors
Graph neural networks (GNNs) have achieved remarkable success in a variety of machine learning tasks over graph data.
Fine-Grained Expressive Power of Weisfeiler-Leman: A Homomorphism Counting Perspective
The ability of graph neural networks (GNNs) to count homomorphisms has recently been proposed as a practical and fine-grained measure of their expressive power.
Distance-Restricted Folklore Weisfeiler-Leman GNNs with Provable Cycle Counting Power
Many of the proposed GNN models with provable cycle counting power are based on subgraph GNNs, i. e., extracting a bag of subgraphs from the input graph, generating representations for each subgraph, and using them to augment the representation of the input graph.
An Efficient Subgraph GNN with Provable Substructure Counting Power
We investigate the enhancement of graph neural networks' (GNNs) representation power through their ability in substructure counting.
Head-driven Phrase Structure Parsing in O($n^3$) Time Complexity
Constituent and dependency parsing, the two classic forms of syntactic parsing, have been found to benefit from joint training and decoding under a uniform formalism, Head-driven Phrase Structure Grammar (HPSG).
SG-Net: Syntax Guided Transformer for Language Representation
In detail, for self-attention network (SAN) sponsored Transformer-based encoder, we introduce syntactic dependency of interest (SDOI) design into the SAN to form an SDOI-SAN with syntax-guided self-attention.
LIMIT-BERT : Linguistics Informed Multi-Task BERT
Besides, LIMIT-BERT takes a semi-supervised learning strategy to offer the same large amount of linguistics task data as that for the language model training.
Semantics-Aware Inferential Network for Natural Language Understanding
Taking explicit contextualized semantics as a complementary input, the inferential module of SAIN enables a series of reasoning steps over semantic clues through an attention mechanism.
Dependency and Span, Cross-Style Semantic Role Labeling on PropBank and NomBank
In this paper, we define a new cross-style semantic role label convention and propose a new cross-style joint optimization model designed around the most basic linguistic meaning of a semantic role, providing a solution to make the results of the two styles more comparable and allowing both formalisms of SRL to benefit from their natural connections in both linguistics and computation.
LIMIT-BERT : Linguistic Informed Multi-Task BERT
In this paper, we present a Linguistic Informed Multi-Task BERT (LIMIT-BERT) for learning language representations across multiple linguistic tasks by Multi-Task Learning (MTL).
Parsing All: Syntax and Semantics, Dependencies and Spans
Both syntactic and semantic structures are key linguistic contextual clues, in which parsing the latter has been well shown beneficial from parsing the former.
Concurrent Parsing of Constituency and Dependency
Constituent and dependency representation for syntactic structure share a lot of linguistic and computational characteristics, this paper thus makes the first attempt by introducing a new model that is capable of parsing constituent and dependency at the same time, so that lets either of the parsers enhance each other.
SG-Net: Syntax-Guided Machine Reading Comprehension
In detail, for self-attention network (SAN) sponsored Transformer-based encoder, we introduce syntactic dependency of interest (SDOI) design into the SAN to form an SDOI-SAN with syntax-guided self-attention.
Ranked #5 on
Question Answering
on SQuAD2.0 dev
Head-Driven Phrase Structure Grammar Parsing on Penn Treebank
In details, we report 96. 33 F1 of constituent parsing and 97. 20\% UAS of dependency parsing on PTB.
Ranked #5 on
Constituency Parsing
on Penn Treebank
