Search Results for author:
Found 19 papers, 9 papers with code
A Pre-training Based Personalized Dialogue Generation Model with Persona-sparse Data
Further, to incorporate the target persona in the decoding process and to balance its contribution, an attention routing structure is devised in the decoder to merge features extracted from the target persona and dialogue contexts using dynamically predicted weights.
Dialogue Distillation: Open-Domain Dialogue Augmentation Using Unpaired Data
Further, a model-level distillation process is employed to distill a teacher model trained on high-quality paired data to augmented dialogue pairs, thereby preventing dialogue models from being affected by the noise in the augmented data.
Stylized Dialogue Response Generation Using Stylized Unpaired Texts
However, this task is far from well-explored due to the difficulties of rendering a particular style in coherent responses, especially when the target style is embedded only in unpaired texts that cannot be directly used to train the dialogue model.
Positional Artefacts Propagate Through Masked Language Model Embeddings
In this work, we demonstrate that the contextualized word vectors derived from pretrained masked language model-based encoders share a common, perhaps undesirable pattern across layers.
Easy and Efficient Transformer : Scalable Inference Solution For large NLP model
To fill such a gap, we introduce a scalable inference solution: Easy and Efficient Transformer (EET), including a series of transformer inference optimization at the algorithm and implementation levels.
OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metrics
Automatic metrics are essential for developing natural language generation (NLG) models, particularly for open-ended language generation tasks such as story generation.
Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherence
Generating long and coherent text is an important but challenging task, particularly for open-ended language generation tasks such as story generation.
KuiLeiXi: a Chinese Open-Ended Text Adventure Game
Equipped with GPT-2 and the latest GPT-3, AI Dungeon has been seen as a famous example of the powerful text generation capabilities of large-scale pre-trained language models, and a possibility for future games.
LOT: A Story-Centric Benchmark for Evaluating Chinese Long Text Understanding and Generation
Therefore, we propose a story-centric benchmark named LOT for evaluating Chinese long text modeling, which aggregates two understanding tasks and two generation tasks.
Transferable Persona-Grounded Dialogues via Grounded Minimal Edits
Grounded dialogue models generate responses that are grounded on certain concepts.
Analyzing the Implicit Position Encoding Ability of Transformer Decoder
A common limitation of Transformer Encoder's self-attention mechanism is that it cannot automatically capture the information of word order, so one needs to feed the explicit position encodings into the target model.
Unsupervised Domain Adaptation with Adapter
However, fine-tuning all the parameters of the PrLM on a small domain-specific corpus distort the learned generic knowledge, and it is also expensive to deployment a whole fine-tuned PrLM for each domain.
Taming Repetition in Dialogue Generation
The wave of pre-training language models has been continuously improving the quality of the machine-generated conversations, however, some of the generated responses still suffer from excessive repetition, sometimes repeating words from utterance, sometimes repeating words within self-generated responses, or both.
Dialog Intent Induction via Density-based Deep Clustering Ensemble
Existing task-oriented chatbots heavily rely on spoken language understanding (SLU) systems to determine a user's utterance's intent and other key information for fulfilling specific tasks.
Youling: an AI-Assisted Lyrics Creation System
In the lyrics generation process, \textit{Youling} supports traditional one pass full-text generation mode as well as an interactive generation mode, which allows users to select the satisfactory sentences from generated candidates conditioned on preceding context.
DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks
In contrast, Transformer Decoder with the causal attention masks is naturally sensitive to the word order.
Unsupervised Representation Learning of Player Behavioral Data with Confidence Guided Masking
Players of online games generate rich behavioral data during gaming.
Easy and Efficient Transformer: Scalable Inference Solution For Large NLP Model
To fill such a gap, we introduce a scalable inference solution: Easy and Efficient Transformer (EET), including a series of transformer inference optimization at the algorithm and implementation levels.
QiuNiu: A Chinese Lyrics Generation System with Passage-Level Input
In this paper, we demonstrate the QiuNiu, a Chinese lyrics generation system which is conditioned on passage-level text rather than a few attributes or keywords.
