Search Results for author:
Found 13 papers, 5 papers with code
Easy and Efficient Transformer: Scalable Inference Solution For Large NLP Model
To fill such a gap, we introduce a scalable inference solution: Easy and Efficient Transformer (EET), including a series of transformer inference optimization at the algorithm and implementation levels.
PromptNER: Prompt Locating and Typing for Named Entity Recognition
Prompt learning is a new paradigm for utilizing pre-trained language models and has achieved great success in many tasks.
Ranked #1 on
Nested Named Entity Recognition
on ACE 2004
Unraveling the Mystery of Artifacts in Machine Generated Text
As neural Text Generation Models (TGM) have become more and more capable of generating text indistinguishable from human-written ones, the misuse of text generation technologies can have serious ramifications.
Probing Simile Knowledge from Pre-trained Language Models
In this paper, we probe simile knowledge from PLMs to solve the SI and SG tasks in the unified framework of simile triple completion for the first time.
DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks
In contrast, Transformer Decoder with the causal attention masks is naturally sensitive to the word order.
I-Tuning: Tuning Frozen Language Models with Image for Lightweight Image Captioning
Different to these heavy-cost models, we introduce a lightweight image captioning framework (I-Tuning), which contains a small number of trainable parameters.
A Frustratingly Simple Approach for End-to-End Image Captioning
Before training the captioning models, an extra object detector is utilized to recognize the objects in the image at first.
Youling: an AI-Assisted Lyrics Creation System
In the lyrics generation process, \textit{Youling} supports traditional one pass full-text generation mode as well as an interactive generation mode, which allows users to select the satisfactory sentences from generated candidates conditioned on preceding context.
Taming Repetition in Dialogue Generation
The wave of pre-training language models has been continuously improving the quality of the machine-generated conversations, however, some of the generated responses still suffer from excessive repetition, sometimes repeating words from utterance, sometimes repeating words within self-generated responses, or both.
Analyzing the Implicit Position Encoding Ability of Transformer Decoder
A common limitation of Transformer Encoder's self-attention mechanism is that it cannot automatically capture the information of word order, so one needs to feed the explicit position encodings into the target model.
KuiLeiXi: a Chinese Open-Ended Text Adventure Game
Equipped with GPT-2 and the latest GPT-3, AI Dungeon has been seen as a famous example of the powerful text generation capabilities of large-scale pre-trained language models, and a possibility for future games.
Easy and Efficient Transformer : Scalable Inference Solution For large NLP model
To fill such a gap, we introduce a scalable inference solution: Easy and Efficient Transformer (EET), including a series of transformer inference optimization at the algorithm and implementation levels.
Dialogue Distillation: Open-Domain Dialogue Augmentation Using Unpaired Data
Further, a model-level distillation process is employed to distill a teacher model trained on high-quality paired data to augmented dialogue pairs, thereby preventing dialogue models from being affected by the noise in the augmented data.
