Search Results for author:
Found 6 papers, 3 papers with code
Deep Partial Multiplex Network Embedding
Network embedding is an effective technique to learn the low-dimensional representations of nodes in networks.
WebFormer: The Web-page Transformer for Structure Information Extraction
Structure information extraction refers to the task of extracting structured text fields from web pages, such as extracting a product offer from a shopping page including product title, description, brand and price.
DOCENT: Learning Self-Supervised Entity Representations from Large Document Collections
This enables a new class of powerful, high-capacity representations that can ultimately distill much of the useful information about an entity from multiple text sources, without any human supervision.
RealFormer: Transformer Likes Residual Attention
Transformer is the backbone of modern NLP models.
Ranked #4 on
Paraphrase Identification
on Quora Question Pairs
Big Bird: Transformers for Longer Sequences
To remedy this, we propose, BigBird, a sparse attention mechanism that reduces this quadratic dependency to linear.
Ranked #1 on
Text Classification
on Arxiv HEP-TH citation graph
ETC: Encoding Long and Structured Inputs in Transformers
Transformer models have advanced the state of the art in many Natural Language Processing (NLP) tasks.
Ranked #3 on
Question Answering
on ConditionalQA
