Search Results for author:
Found 14 papers, 9 papers with code
Zero-Shot Event Detection Based on Ordered Contrastive Learning and Prompt-Based Prediction
Event detection is a classic natural language processing task.
Word Reordering for Zero-shot Cross-lingual Structured Prediction
Adapting word order from one language to another is a key problem in cross-lingual structured prediction.
A Unified Encoding of Structures in Transition Systems
Transition systems usually contain various dynamic structures (e. g., stacks, buffers).
Length Generalization of Causal Transformers without Position Encoding
Generalizing to longer sentences is important for recent Transformer-based language models.
LongHeads: Multi-Head Attention is Secretly a Long Context Processor
Instead of allowing each head to attend to the full sentence, which struggles with generalizing to longer sequences due to out-of-distribution (OOD) issues, we allow each head to process in-distribution length by selecting and attending to important context chunks.
StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback
The advancement of large language models (LLMs) has significantly propelled the field of code generation.
MouSi: Poly-Visual-Expert Vision-Language Models
This technique introduces a fusion network to unify the processing of outputs from different visual experts, while bridging the gap between image encoders and pre-trained LLMs.
Ranked #40 on
Visual Question Answering
on MM-Vet
Secrets of RLHF in Large Language Models Part II: Reward Modeling
We introduce a series of novel methods to mitigate the influence of incorrect and ambiguous preferences in the dataset and fully leverage high-quality preference data.
FOSS: A Self-Learned Doctor for Query Optimizer
They either learn to construct plans from scratch in a bottom-up manner or guide the plan generation behavior of traditional optimizer using hints.
Evaluator for Emotionally Consistent Chatbots
One challenge for evaluating current sequence- or dialogue-level chatbots, such as Empathetic Open-domain Conversation Models, is to determine whether the chatbot performs in an emotionally consistent way.
Generating CCG Categories
Previous CCG supertaggers usually predict categories using multi-class classification.
Graph-based Dependency Parsing with Graph Neural Networks
We investigate the problem of efficiently incorporating high-order features into neural graph-based dependency parsing.
Ranked #12 on
Dependency Parsing
on Penn Treebank
AntNLP at CoNLL 2018 Shared Task: A Graph-Based Parser for Universal Dependency Parsing
We describe the graph-based dependency parser in our system (AntNLP) submitted to the CoNLL 2018 UD Shared Task.
A Fast and Lightweight System for Multilingual Dependency Parsing
We present a multilingual dependency parser with a bidirectional-LSTM (BiLSTM) feature extractor and a multi-layer perceptron (MLP) classifier.
