Search Results for author:
Found 25 papers, 8 papers with code
Towards Enhancing Faithfulness for Neural Machine Translation
Neural machine translation (NMT) has achieved great success due to the ability to generate high-quality sentences.
Two Minds Better Than One: Collaborative Reward Modeling for LLM Alignment
To address this challenge, we propose an online Collaborative Reward Modeling (CRM) framework to achieve robust preference learning through peer review and curriculum learning.
Investigating and Scaling up Code-Switching for Multilingual Language Model Pre-Training
Large language models (LLMs) exhibit remarkable multilingual capabilities despite the extreme language imbalance in the pre-training data.
FRAMES: Boosting LLMs with A Four-Quadrant Multi-Stage Pretraining Strategy
Large language models (LLMs) have significantly advanced human language understanding and generation, with pretraining data quality and organization being crucial to their performance.
Look Before You Leap: Enhancing Attention and Vigilance Regarding Harmful Content with GuidelineLLM
This vulnerability poses significant risks to the real-world applications.
Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision
Experiments show that the method improves the actor's exploration efficiency and solution diversity, especially on challenging queries, leading to a stronger reasoning model.
Multi-Programming Language Sandbox for LLMs
We introduce MPLSandbox, an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler and analysis tools for Large Language Models (LLMs).
Length Desensitization in Direct Preference Optimization
Direct Preference Optimization (DPO) is widely utilized in the Reinforcement Learning from Human Feedback (RLHF) phase to align Large Language Models (LLMs) with human preferences, thereby enhancing both their harmlessness and efficacy.
What's Wrong with Your Code Generated by Large Language Models? An Extensive Study
The increasing development of large language models (LLMs) in code generation has drawn significant attention among researchers.
The Rise and Potential of Large Language Model Based Agents: A Survey
Many efforts have been made to develop intelligent agents, but they mainly focus on advancement in algorithms or training strategies to enhance specific capabilities or performance on particular tasks.
Secrets of RLHF in Large Language Models Part I: PPO
Therefore, we explore the PPO-max, an advanced version of PPO algorithm, to efficiently improve the training stability of the policy model.
Towards Reliable Neural Machine Translation with Consistency-Aware Meta-Learning
A contributing factor to this problem is that NMT models trained with the one-to-one paradigm struggle to handle the source diversity phenomenon, where inputs with the same meaning can be expressed differently.
Learning Decoupled Retrieval Representation for Nearest Neighbour Neural Machine Translation
Generally, kNN-MT borrows the off-the-shelf context representation in the translation task, e. g., the output of the last decoder layer, as the query vector of the retrieval task.
Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translation
Although data augmentation is widely used to enrich the training data, conventional methods with discrete manipulations fail to generate diverse and faithful training samples.
Uncertainty-Aware Semantic Augmentation for Neural Machine Translation
As a sequence-to-sequence generation task, neural machine translation (NMT) naturally contains intrinsic uncertainty, where a single sentence in one language has multiple valid counterparts in the other.
On Learning Universal Representations Across Languages
Recent studies have demonstrated the overwhelming advantage of cross-lingual pre-trained models (PTMs), such as multilingual BERT and XLM, on cross-lingual NLP tasks.
Contrastive Learning
Cross-Lingual Natural Language Inference
+5
Multiscale Collaborative Deep Models for Neural Machine Translation
Recent evidence reveals that Neural Machine Translation (NMT) models with deeper neural networks can be more effective but are difficult to train.
AR: Auto-Repair the Synthetic Data for Neural Machine Translation
Compared with only using limited authentic parallel data as training corpus, many studies have proved that incorporating synthetic parallel data, which generated by back translation (BT) or forward translation (FT, or selftraining), into the NMT training process can significantly improve translation quality.
GRET: Global Representation Enhanced Transformer
The encoder maps the words in the input sentence into a sequence of hidden states, which are then fed into the decoder to generate the output sentence.
Acquiring Knowledge from Pre-trained Model to Neural Machine Translation
The standard paradigm of exploiting them includes two steps: first, pre-training a model, e. g. BERT, with a large scale unlabeled monolingual data.
Improving Neural Machine Translation with Pre-trained Representation
Then, we design a framework for integrating both source and target sentence-level representations into NMT model to improve the translation quality.
Learning Representation Mapping for Relation Detection in Knowledge Base Question Answering
However, one critical problem is that current approaches only get high accuracy for questions whose relations have been seen in the training data.
Correct-and-Memorize: Learning to Translate from Interactive Revisions
Experiments in both ideal and real interactive translation settings demonstrate that our proposed \method enhances machine translation results significantly while requires fewer revision instructions from human compared to previous methods.
Learning to Discriminate Noises for Incorporating External Information in Neural Machine Translation
Previous studies show that incorporating external information could improve the translation quality of Neural Machine Translation (NMT) systems.
Neural Machine Translation with Word Predictions
In the encoder-decoder architecture for neural machine translation (NMT), the hidden states of the recurrent structures in the encoder and decoder carry the crucial information about the sentence. These vectors are generated by parameters which are updated by back-propagation of translation errors through time.
