Search Results for author:
Found 30 papers, 7 papers with code
CoachLM: Automatic Instruction Revisions Improve the Data Quality in LLM Instruction Tuning
Instruction tuning is crucial for enabling Language Learning Models (LLMs) in responding to human instructions.
Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation
The second step involves preserving dataset diversity through a clustering process. In our experiment, CaR selected a subset containing only 1. 96% of Alpaca's IT data, yet the underlying AlpaCaR model trained on this subset outperforms Alpaca by an average of 32. 1% in GPT-4 evaluations.
Interpretable Online Log Analysis Using Large Language Models with Prompt Strategies
LogPrompt employs large language models (LLMs) to perform online log analysis tasks via a suite of advanced prompt strategies tailored for log tasks, which enhances LLMs' performance by up to 380. 7% compared with simple prompts.
Unify word-level and span-level tasks: NJUNLP's Participation for the WMT2023 Quality Estimation Shared Task
We generate pseudo MQM data using parallel data from the WMT translation task.
Neighbors Are Not Strangers: Improving Non-Autoregressive Translation under Low-Frequency Lexical Constraints
To this end, we propose a plug-in algorithm for this line of work, i. e., Aligned Constrained Training (ACT), which alleviates this problem by familiarizing the model with the source-side context of the constraints.
Translate Meanings, Not Just Words: IdiomKB's Role in Optimizing Idiomatic Translation with Language Models
To translate well, machine translation (MT) systems and general-purposed language models (LMs) need a deep understanding of both source and target languages and cultures.
Collective Human Opinions in Semantic Textual Similarity
Despite the subjective nature of semantic textual similarity (STS) and pervasive disagreements in STS annotation, existing benchmarks have used averaged human ratings as the gold standard.
The HW-TSC's Offline Speech Translation Systems for IWSLT 2021 Evaluation
This paper describes our work in participation of the IWSLT-2021 offline speech translation task.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+5
HI-CMLM: Improve CMLM with Hybrid Decoder Input
Mask-predict CMLM (Ghazvininejad et al., 2019) has achieved stunning performance among non-autoregressive NMT models, but we find that the mechanism of predicting all of the target words only depending on the hidden state of [MASK] is not effective and efficient in initial iterations of refinement, resulting in ungrammatical repetitions and slow convergence.
Make the Blind Translator See The World: A Novel Transfer Learning Solution for Multimodal Machine Translation
Based on large-scale pretrained networks and the liability to be easily overfitting with limited labelled training data of multimodal translation (MMT) is a critical issue in MMT.
HW-TSC’s Participation at WMT 2020 Automatic Post Editing Shared Task
The paper presents the submission by HW-TSC in the WMT 2020 Automatic Post Editing Shared Task.
HW-TSC’s Participation at WMT 2020 Quality Estimation Shared Task
This paper presents our work in the WMT 2020 Word and Sentence-Level Post-Editing Quality Estimation (QE) Shared Task.
How Length Prediction Influence the Performance of Non-Autoregressive Translation?
Length prediction is a special task in a series of NAT models where target length has to be determined before generation.
UniLog: Deploy One Model and Specialize it for All Log Analysis Tasks
UniLog: Deploy One Model and Specialize it for All Log Analysis Tasks
Joint-training on Symbiosis Networks for Deep Nueral Machine Translation models
Deep encoders have been proven to be effective in improving neural machine translation (NMT) systems, but it reaches the upper bound of translation quality when the number of encoder layers exceeds 18.
Self-Distillation Mixup Training for Non-autoregressive Neural Machine Translation
An effective training strategy to improve the performance of AT models is Self-Distillation Mixup (SDM) Training, which pre-trains a model on raw data, generates distilled data by the pre-trained model itself and finally re-trains a model on the combination of raw data and distilled data.
Diformer: Directional Transformer for Neural Machine Translation
In this paper, we aim to close the gap by preserving the original objective of AR and NAR under a unified framework.
HW-TSC’s Participation in the WMT 2021 Efficiency Shared Task
This paper presents the submission of Huawei Translation Services Center (HW-TSC) to WMT 2021 Efficiency Shared Task.
HW-TSC’s Participation at WMT 2021 Quality Estimation Shared Task
This paper presents our work in WMT 2021 Quality Estimation (QE) Shared Task.
The HW-TSC’s Offline Speech Translation System for IWSLT 2022 Evaluation
For machine translation part, we pretrained three translation models on WMT21 dataset and fine-tuned them on in-domain corpora.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+3
The HW-TSC’s Speech to Speech Translation System for IWSLT 2022 Evaluation
The paper presents the HW-TSC’s pipeline and results of Offline Speech to Speech Translation for IWSLT 2022.
Capture Human Disagreement Distributions by Calibrated Networks for Natural Language Inference
Natural Language Inference (NLI) datasets contain examples with highly ambiguous labels due to its subjectivity.
HW-TSC at SemEval-2022 Task 7: Ensemble Model Based on Pretrained Models for Identifying Plausible Clarifications
This paper describes the system for the identifying Plausible Clarifications of Implicit and Underspecified Phrases.
HwTscSU’s Submissions on WAT 2022 Shared Task
In this paper we describe our submission to the shared tasks of the 9th Workshop on Asian Translation (WAT 2022) on NICT–SAP under the team name ”HwTscSU”.
P-Transformer: Towards Better Document-to-Document Neural Machine Translation
To alleviate this problem, we propose a position-aware Transformer (P-Transformer) to enhance both the absolute and relative position information in both self-attention and cross-attention.
Knowledge-Prompted Estimator: A Novel Approach to Explainable Machine Translation Assessment
Cross-lingual Machine Translation (MT) quality estimation plays a crucial role in evaluating translation performance.
UCorrect: An Unsupervised Framework for Automatic Speech Recognition Error Correction
Previous works usually adopt end-to-end models and has strong dependency on Pseudo Paired Data and Original Paired Data.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
DeMPT: Decoding-enhanced Multi-phase Prompt Tuning for Making LLMs Be Better Context-aware Translators
In this paper, we propose an alternative adaptation approach, named Decoding-enhanced Multi-phase Prompt Tuning (DeMPT), to make LLMs discriminately model and utilize the inter- and intra-sentence context and more effectively adapt LLMs to context-aware NMT.
From Handcrafted Features to LLMs: A Brief Survey for Machine Translation Quality Estimation
Machine Translation Quality Estimation (MTQE) is the task of estimating the quality of machine-translated text in real time without the need for reference translations, which is of great importance for the development of MT.
