Search Results for author: Guande He

Found 4 papers, 2 papers with code

Noise Contrastive Alignment of Language Models with Explicit Rewards

1 code implementation8 Feb 2024 Huayu Chen, Guande He, Hang Su, Jun Zhu

Existing alignment methods, such as Direct Preference Optimization (DPO), are mainly tailored for pairwise preference data where rewards are implicitly defined rather than explicitly given.

Language Modelling

Schrodinger Bridges Beat Diffusion Models on Text-to-Speech Synthesis

no code implementations6 Dec 2023 Zehua Chen, Guande He, Kaiwen Zheng, Xu Tan, Jun Zhu

Specifically, we leverage the latent representation obtained from text input as our prior, and build a fully tractable Schrodinger bridge between it and the ground-truth mel-spectrogram, leading to a data-to-data process.

Speech Synthesis Text-To-Speech Synthesis

Investigating Uncertainty Calibration of Aligned Language Models under the Multiple-Choice Setting

no code implementations18 Oct 2023 Guande He, Peng Cui, Jianfei Chen, WenBo Hu, Jun Zhu

Despite the significant progress made in practical applications of aligned language models (LMs), they tend to be overconfident in output answers compared to the corresponding pre-trained LMs.

Multiple-choice

Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Models

1 code implementation30 May 2023 Guande He, Jianfei Chen, Jun Zhu

In light of these observations, we evaluate the calibration of several methods that preserve pre-trained features and show that preserving pre-trained features can improve the calibration of fine-tuned language models.

Language Modelling Masked Language Modeling +1

Cannot find the paper you are looking for? You can Submit a new open access paper.