Search Results for author: Qingyi Liu

Found 3 papers, 2 papers with code

Dual Modalities of Text: Visual and Textual Generative Pre-training

no code implementations16 Apr 2024 Yekun Chai, Qingyi Liu, Jingwu Xiao, Shuohuan Wang, Yu Sun, Hua Wu

Harnessing visual texts represents a burgeoning frontier in the evolution of language modeling.

Language Modelling

On Training Data Influence of GPT Models

1 code implementation11 Apr 2024 Qingyi Liu, Yekun Chai, Shuohuan Wang, Yu Sun, Qiwei Peng, Keze Wang, Hua Wu

This paper presents GPTfluence, a novel approach that leverages a featurized simulation to assess the impact of training examples on the training dynamics of GPT models.

Natural Language Understanding

UBARv2: Towards Mitigating Exposure Bias in Task-Oriented Dialogs

1 code implementation15 Sep 2022 Yunyi Yang, Hong Ding, Qingyi Liu, Xiaojun Quan

This paper studies the exposure bias problem in task-oriented dialog systems, where the model's generated content over multiple turns drives the dialog context away from the ground-truth distribution at training time, introducing error propagation and damaging the robustness of the TOD system.

Cannot find the paper you are looking for? You can Submit a new open access paper.